Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

336698131 · May 202619922001200920172026
48 results for second-order corrections

The aim of this short note is to fill in a gap in our earlier paper [16] on 2BSDEs with reflections, and to explain how to correct the subsequent results in the second paper [15]. We also provide more insight on the properties of 2RBSDEs, in the light of the recent contributions [13, 23] in the so--called GG-framework…

2017-06-26abs ↗pdf ↗

UCBMQ improves Q-learning by adding momentum to correct bias and limit regret.

problem Improving Q-learning's bias and regret in reinforcement learning.
method UCBMQ combines Q-learning with an upper confidence bound and momentum term.
result UCBMQ guarantees a regret of O(H3SAT+H4SA)O(\sqrt{H^3SAT}+ H^4 S A ) with a linear second-order term in SS.

We study first and second order conformal symmetries of the Yamabe Laplacian on a general pseudo-Riemannian manifold and of the Paneitz operator on Einstein spaces. We show that first order conformal symmetries of the Yamabe operator induce second order conformal symmetries. We show that on an Einstein space every conf…

2015-04-15abs ↗pdf ↗

Method studies equivalence of second order ODEs under specific transformations.

problem Classifying second order ODEs modulo fibre-preserving transformations.
method Using Moser's method of normal forms and Lie algebra computations.
result Normal forms can be used to prove fibre-preserving equivalence.

Improved method finds second-order stationary points privately with better efficiency.

problem Finding second-order stationary points privately under differential privacy constraints.
method Adaptive batch sizes and binary tree mechanism.
result Improved bound for privately finding SOSP, matching state-of-the-art for FOSP.

AMAGOLD improves stochastic gradient MCMC by infrequent Metropolis-Hastings corrections.

problem Bias in stochastic gradient Hamiltonian Monte Carlo (SGHMC).
method AMAGOLD infrequently uses Metropolis-Hastings corrections to remove bias, with a fixed step size schedule.
result AMAGOLD converges to the target distribution with a fixed, rather than a diminishing, step size, and at most a constant factor slower convergence rate.

AdamNX improves Adam's stability by adjusting its learning rate.

problem Adam's tendency to converge to non-flat minima in large-scale models.
method Proposes a novel exponential decay mechanism for Adam's second-order moment estimate.
result AdamNX outperforms Adam and its variants in stability and performance.

New algorithms solve complex minimax problems efficiently.

problem Nonconvex-strongly concave minimax problems in machine learning.
method Gradient norm regularized trust-region (GRTR) and Levenberg-Marquardt (LMNegCur) algorithms.
result Proved iteration complexities matching best known results.

Improved Adam for time series forecasting with distributional drift.

problem Non-stationary data challenges Adam's effectiveness.
method Proposed TS_Adam, removing Adam's second-order bias correction.
result TS_Adam achieves 12.8% reduction in MSE and 5.7% in MAE on ETT datasets.

New method solves stochastic optimization problems with random models.

problem Optimizing stochastic objectives with deterministic constraints.
method Trust-Region Sequential Quadratic Programming with random model.
result Global convergence guarantees for first- and second-order stationary points.

New method identifies physical constants from video data alone.

problem Identifying physical constants from video data.
method Proves level-set slope-coverage condition ensures local affine mapping to true physical state, enabling exact parameter recovery.
result Underdamped systems identifiable from a single video clip, other regimes require three diverse trajectories.

New technique debiases distributed optimization, improving convergence rate.

problem Bias in local estimates limits effectiveness of distributed second order optimization.
method Surrogate sketching and scaled regularization to eliminate bias.
result The debiased local estimates lead to faster convergence in distributed optimization.

New method provides tighter robustness guarantees for adversarial attacks.

problem Ensuring robustness against adversarial attacks in machine learning models.
method Developed a Second-order Smoothing (SoS) robustness certificate using Gaussian random smoothing.
result SoS certificates are tighter and provide improved robustness on high-dimensional datasets.

A method makes particle filters differentiable without altering their forward pass.

problem Compatibility issues between particle filters and automatic differentiation.
method Introduces a correction to particle weights using the stop-gradient operator.
result Automatic differentiation produces good estimators for gradients and second-order derivatives.

Goursat showed that in the presence of an intermediate integral, the problem of solving a second-order Monge-Ampere equation can be reduced to solving a first-order equation, in the sense that the generic solution of the first-order equation will also be a solution of the original equation. An attempt by Hermann to giv…

1998-04-06abs ↗pdf ↗

New geometric quantities help classify manifolds and relate to entropy.

problem Classifying Riemannian manifolds using geometric quantities.
method Introducing and analyzing asymptotic geometric quantities like p-capacity, eigenvalues, and Maz'ya constant.
result Geometric quantities coincide with entropy in specific conditions, characterizing manifolds.

Study dynamic risk measures with distributional uncertainty using optimal transport.

problem Risk robustification under distributional uncertainty in Markovian models.
method Characterize risk measures via convex monotone semigroups and optimal transport costs.
result Identify generator and correction terms for dynamic risk measures under different scaling regimes.

A lightweight framework improves convergence and stability of PINNs for complex PDEs.

problem Training instability and reduced accuracy in PINNs for complex PDEs.
method Adaptive curvature correction using secant information to optimize first-order optimizers.
result Consistent improvements in convergence speed, stability, and accuracy over standard optimizers.

C-kNN-LSH identifies similar patient histories for causal inference in longitudinal data.

problem Estimating causal effects from longitudinal trajectories with high-dimensional confounding.
method C-kNN-LSH uses locality-sensitive hashing to find clinical twins and estimate treatment effects.
result C-kNN-LSH outperforms existing methods in capturing recovery heterogeneity and estimating policy values.

We examine the fixed points to first-order RG flow of a non-linear sigma model with background metric, dilaton and tachyon fields. We show that on compact target spaces, the existence of fixed points with non-zero tachyon is linked to the sign of the second derivative of the tachyon potential V(T)V''(T) (this is the anal…

2006-05-23abs ↗pdf ↗

This text is a survey on cross-validation. We define all classical cross-validation procedures, and we study their properties for two different goals: estimating the risk of a given estimator, and selecting the best estimator among a given family. For the risk estimation problem, we compute the bias (which can also be …

2017-03-09abs ↗pdf ↗

The study derives generalization bounds for neural oscillators, improving their performance with regularization.

problem Quantifying the generalization capacities of neural oscillators.
method Using Rademacher complexity and squared Wasserstein-1 distances, the study derives theoretical upper PAC generalization bounds for neural oscillators.
result Theoretical bounds show polynomial growth in estimation errors with MLP size and time length, and regularization improves performance.

Upper Confidence Bound (UCB) method is arguably the most celebrated one used in online decision making with partial information feedback. Existing techniques for constructing confidence bounds are typically built upon various concentration inequalities, which thus lead to over-exploration. In this paper, we propose a n…

2019-06-12abs ↗pdf ↗

Second-order economic theory considers new variables to improve price volatility predictions.

problem Current economic models focus on first-order variables, missing second-order variables that affect price volatility.
method Introduces second-order economic theory with new variables composed of sums of squares of agents' transactions.
result Second-order economic theory complements first-order variables and introduces new macroeconomic variables.

Improved stochastic approximation method reduces residual error.

problem Reducing residual error in stochastic approximation algorithms.
method Fixed-schedule one-quarter barrier and bias-corrected acceleration.
result Achieves T1/2+o(1)T^{-1/2+o(1)} residual reduction with O(1)O(1) primitive samples.

Second-order optimizers retain residual information after data deletion, affecting machine unlearning.

problem Residual information in second-order optimizers after data deletion.
method Comparison of first-order and second-order learners, eigendecomposition analysis.
result Second-order optimizers retain residual information, not detectable by first-order analysis.

Exact second-order optimization for deep learning reduces computational cost and improves performance.

problem Inadequate use of second-order optimization methods in deep learning due to high computational cost and non-convexity.
method Developed an exact stochastic second-order Newton method that addresses the non-convexity issue and provides an expression for the stochastic Hessian.
result Exact second-order Newton direction formula and its application in deep learning datasets.

Proposes a new framework for invariant quadratic P&L predictions in option books.

problem Inconsistent second-order P&L predictions across different factor parameterizations.
method Local, model-agnostic framework using covariant Hessian defined by an affine connection.
result Coordinate-invariant quadratic P&L predictions that match desk targets.

SOLBP extends efficient inference to uncertain Bayesian networks.

problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.

Developed a theory of local convexity for second order differential equations on Lie algebroids.

problem Analyzing convexity in differential equations on Lie algebroids.
method Theory development for local convexity of SODEs on Lie algebroids.
result Extensive discussion of homogeneous quadratic SODEs on Lie algebroids.

Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.

problem Capturing higher-order tail behavior and dependence effects in risk measures.
method Second-order asymptotic expansions using extreme value theory and regular variation theory.
result Second-order approximations reduce approximation errors, especially at extreme confidence levels.

Negative step sizes improve second-order methods for neural networks.

problem Second-order methods discard negative curvature, limiting their effectiveness.
method Introduce negative step sizes in second-order methods combined with Wolfe line search.
result Negative step sizes lead to global convergence and improved performance.