Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

177355532709 · Jun 202019922001200920172026
48 results for first order

Study first-order locally convex Lie algebroids in Bastiani calculus.

problem Define and study first-order locally convex Lie algebroids.
method Define sheaves of Lie algebroid forms and morphisms, prove category structure, study representations and cohomology.
result First-order locally convex Lie algebroids form a category and have applications in Lie II theorems.

Optimal first-order methods are shown to be fundamental limits in functional estimation.

problem Optimal functional estimation under weak conditions.
method Formalization of functional estimation with black-box nuisance function estimates and derivation of minimax lower bounds.
result First-order methods are optimal under weak conditions, but higher-order methods can outperform them when nuisance function structure is known.

We consider first order expansions of convex penalized estimators in high-dimensional regression problems with random designs. Our setting includes linear regression and logistic regression as special cases. For a given penalty function hh and the corresponding penalized estimator β^\hatβ, we construct a quantity ηη,…

2019-10-12abs ↗pdf ↗

A new first-order sampler improves diffusion probabilistic model sampling quality.

problem The belief that first-order methods are inherently slower for diffusion probabilistic model sampling.
method A novel training-free, first-order sampler that approximates the forward-value evaluation via a one-step lookahead predictor.
result The proposed sampler provably approximates the ideal forward-value trajectory while retaining first-order convergence and can improve sample quality under the same NFE budget.

A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher…

2019-07-25abs ↗pdf ↗

Extends a theorem for first-order elliptic operators on manifolds.

problem Proving the relative index theorem for general first-order elliptic operators.
method Using boundary value problems and graphical decomposition of elliptically regular boundary conditions.
result Proves the relative index theorem for general first-order elliptic operators.

The aim of this paper is fourfold. Firstly, we introduce and study the f-ultra-harmonic maps. Secondly, we recall the geometric dynamics generated by a first order normal PDE system and we give original results regarding the geometric dynamics generated by other first order PDE systems. Thirdly, we determine the Gauss …

2011-10-13abs ↗pdf ↗

First order discretizations of Langevin diffusion can achieve better generalization error with additional smoothness assumptions.

problem Analyzing generalization error for first order discretizations of Langevin diffusion.
method Providing a sufficient smoothness condition to show that first order methods can achieve arbitrarily runtime complexity for a given expected generalization error.
result First order methods can achieve arbitrarily runtime complexity with additional smoothness assumptions.

In this paper we derive a second order approximation for an infinite dimensional limit order book model, in which the dynamics of the incoming order flow is allowed to depend on the current market price as well as on a volume indicator (e.g.~the volume standing at the top of the book). We study the fluctuations of the …

2017-08-24abs ↗pdf ↗

Second-order optimizers retain residual information after data deletion, affecting machine unlearning.

problem Residual information in second-order optimizers after data deletion.
method Comparison of first-order and second-order learners, eigendecomposition analysis.
result Second-order optimizers retain residual information, not detectable by first-order analysis.

A new method learns node embeddings for signed directed networks by capturing both first-order and high-order topologies.

problem Learning representative node embeddings for signed directed networks considering both first-order and high-order topologies.
method Proposes a decoupled variational embedding (DVE) method that leverages a specially designed auto-encoder structure to capture both first-order and high-order topologies.
result Extensive experiments on real-world datasets show the effectiveness of DVE in link sign prediction and node recommendation tasks.

CEFOL uses deep learning for dynamic programming with recursive utility.

problem Challenges in solving dynamic programming problems with recursive utility.
method Introduces a separate neural network for certainty equivalent, uses first-order optimality conditions to learn value and policy functions.
result CEFOL achieves high accuracy in learning value and policy functions, matching VFI benchmarks.

First-order method solves stochastic bilevel optimization with linear constraints.

problem Stochastic bilevel optimization with linear constraints and noise.
method Developed a novel framework using gradient-based techniques and smoothed penalty functions.
result Achieved finite-time convergence guarantees for (δ,ε)(δ, ε)-Goldstein stationary points.

We establish that first-order methods avoid saddle points for almost all initializations. Our results apply to a wide variety of first-order methods, including gradient descent, block coordinate descent, mirror descent and variants thereof. The connecting thread is that such algorithms can be studied from a dynamical s…

2017-10-20abs ↗pdf ↗

Graph Convolution Network (GCN) has been recognized as one of the most effective graph models for semi-supervised learning, but it extracts merely the first-order or few-order neighborhood information through information propagation, which suffers performance drop-off for deeper structure. Existing approaches that deal…

2019-11-11abs ↗pdf ↗

We construct a lagrangian geometric formulation for first-order field theories using the canonical structures of first-order jet bundles, which are taken as the phase spaces of the systems in consideration. First of all, we construct all the geometric structures associated with a first-order jet bundle and, using them,…

1995-05-17abs ↗pdf ↗

New algorithm reduces online decision-making regret with efficient LP re-solving and parallel first-order method.

problem Worse regret guarantees and high computational cost of LP-based OLP algorithms.
method Combines LP-based and first-order OLP methods, re-solving LP subproblems periodically and using parallel first-order method.
result Achieves O(log(T/f)+f)\mathscr{O}(\log (T/f) + \sqrt{f}) regret, balancing computational efficiency and superior regret guarantee.

We develop a second-order model for limit order books in a single scaling regime.

problem Modeling price and volume dynamics in a limit order book with market and limit orders at a common time scale.
method Established a first- and second-order approximation for an infinite dimensional limit order book model.
result Proved the existence and uniqueness of a solution for the second-order approximation.

Unified bounds for iterative algorithms with Gaussian data matrices.

problem Establishing non-asymptotic bounds for iterative algorithms with Gaussian data.
method Explicit coupling between iterates and Gaussian process with deterministic covariance.
result Tight, dimension-free bounds for generalized first-order methods.

DEO uses gradient information to escape saddle points in neural networks.

problem Training deep neural networks struggles with flat regions and saddle points.
method Dimer-Enhanced Optimization (DEO) uses gradient information to estimate curvature and escape saddle points.
result DEO improves training efficiency and performance compared to standard first-order methods.

Solves second-order PDEs using quotients and differential invariants.

problem Solving second-order PDEs with first-order quotients.
method Solve the quotient PDE using differential invariants, then add new constraints to solve the original PDE.
result New method for solving second-order scalar PDEs with infinite-dimensional symmetry algebras.

A first-order model for a stock market assigns to each stock a return parameter and a variance parameter that depend only on the rank of the stock. A second-order model assigns these parameters based on both the rank and the name of the stock. First- and second-order models exhibit stability properties that make them a…

2013-02-15abs ↗pdf ↗

Second-order economic theory considers new variables to improve price volatility predictions.

problem Current economic models focus on first-order variables, missing second-order variables that affect price volatility.
method Introduces second-order economic theory with new variables composed of sums of squares of agents' transactions.
result Second-order economic theory complements first-order variables and introduces new macroeconomic variables.

Variance reduction techniques like SVRG provide simple and fast algorithms for optimizing a convex finite-sum objective. For nonconvex objectives, these techniques can also find a first-order stationary point (with small gradient). However, in nonconvex optimization it is often crucial to find a second-order stationary…

2019-05-01abs ↗pdf ↗

Paper develops a TR-SSQP method for noisy optimization with heavy-tailed noise.

problem Optimization problems with stochastic objectives and heavy-tailed noise.
method Trust-Region Stochastic Sequential Quadratic Programming (TR-SSQP) method.
result Achieves high-probability first-order and second-order stationarity bounds for heavy-tailed noise.

A first-order Lagrangian LL^\nabla variationally equivalent to the second-order Einstein-Hilbert Lagrangian is introduced. Such a Lagrangian depends on a symmetric linear connection, but the dependence is covariant under diffeomorphisms. The variational problem defined by LL^\nabla is proved to be regular and its H…

2013-06-05abs ↗pdf ↗

New sampling method guarantees approximate first-order stationary points for non-convex functions.

problem Sampling from non-log-concave densities with non-convex potential functions.
method Averaged Langevin Monte Carlo with complexity analysis.
result Langevin Monte Carlo outputs a sample with ε-relative Fisher information after O(L²d²/ε²) iterations.