Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

122244365487 · Jun 202019922001200920172026
48 results for step order

Optimizes random forest inference by defining step order to maximize accuracy.

problem Limited inference time in resource-constrained systems.
method Designs anytime random forest algorithm on step granularity, proposing optimal step order.
result Backward Squirrel Order performs nearly as well as the optimal step order.

Negative step sizes improve second-order methods for neural networks.

problem Second-order methods discard negative curvature, limiting their effectiveness.
method Introduce negative step sizes in second-order methods combined with Wolfe line search.
result Negative step sizes lead to global convergence and improved performance.

The second order method as Newton Step is a suitable technique in Online Learning to guarantee regret bound. The large data is a challenge in Newton method to store second order matrices as hessian. In this paper, we have proposed an modified online Newton step that store first and second order matrices of dimension m …

2019-04-11abs ↗pdf ↗

Improved solver maintains positivity and accuracy across all time steps.

problem Linear second-order schemes for Fokker-Planck equation cannot preserve positivity.
method Flux-Corrected Diagonal Frog (FCDF) framework using nonlinear extension and iterative limiter.
result FCDF schemes are unconditionally positive across all time steps and maintain second-order accuracy.

NMC improves MCMC convergence by analyzing gradients to determine optimal proposal densities.

problem Improving MCMC convergence in structured relational models.
method Newtonian Monte Carlo (NMC) uses first and second order gradients to determine a suitable proposal density.
result NMC outperforms existing methods in various domains, including non-conjugate models.

A two-step nonparametric method estimates financial systemic risk.

problem Estimating CoVaR due to unobservability of multivariate-quantiles.
method Two-step nonparametric approach using Monte-Carlo simulation and kernel method.
result Consistency and asymptotic normality of the two-step estimator established.

Optimistic method adapted for faster convex-concave min-max problems.

problem Solving convex-concave min-max optimization problems efficiently.
method Adaptive, line search-free second-order methods combining optimistic updates and second-order information.
result Achieves optimal convergence rate without line search or backtracking.

A higher-order Runge-Kutta optimizer performs poorly compared to Adam when evaluated fairly.

problem Evaluating the performance of adaptive Runge-Kutta optimizers under strict conditions.
method Built and evaluated a representative Adam variant using a Bogacki-Shampine 3(2) RK pair, FSAL reuse, and local-error step control.
result The adaptive nature of the RK optimizer is illusory; it behaves like a fixed-step optimizer with gradient averaging.

The mean-field variant of the model of limit order driven market introduced recently by Maslov is formulated and solved. The agents do not have any strategies and the memory of the system is kept within the order book. We show that he evolution of the order book is governed by a matrix multiplicative process. The resul…

2001-04-27abs ↗pdf ↗

New method solves stochastic optimization problems with random models.

problem Optimizing stochastic objectives with deterministic constraints.
method Trust-Region Sequential Quadratic Programming with random model.
result Global convergence guarantees for first- and second-order stationary points.

We present a new microscopic stochastic model for an ensemble of interacting investors that buy and sell stocks in discrete time steps via limit orders based on individual forecasts about the price of the stock. These orders determine the supply and demand fixing after each round (time step) the new price of the stock …

1999-03-04abs ↗pdf ↗

Enhances CEV model pricing with high-order scheme and adaptive time stepping.

problem Improving accuracy in pricing American CEV models with irregularities.
method High-order time adapted scheme, local mesh refinement, adaptive time stepping, fifth-order 5(4) Dormand-Prince method.
result Highly accurate solution with reduced computational runtime.

Study improves BN TTA under distribution shift using higher-order asymptotics.

problem Improving BN TTA for changing data distributions.
method Integrates Edgeworth expansion and saddlepoint approximation with one-step M-estimation.
result Derives optimal weighting parameter for minimized mean-squared error.

Paper proposes a new method for efficient second-order neural network training.

problem Infeasibility of Hessian calculation and noisy second-order information in deep learning.
method Adopting complex-step directional derivative (CSFD) for accurate Hessian computation and designing an effective Newton Krylov procedure.
result Our method outperforms existing methods and often converges one-order faster.

LOBDIF predicts limit order book events using a diffusion model.

problem Predicting the timing and type of events in a dynamic market system.
method LOBDIF uses a diffusion model to learn the complex time-event distribution in limit order book streams.
result LOBDIF significantly outperforms existing methods in real-world data experiments.

A new method for faster optimization of noisy functions.

problem Optimizing noisy functions efficiently.
method A universal and adaptive second-order method for convex functions.
result Achieves O(σ/T)O(σ/ \sqrt{T}) convergence for stochastic oracles and O(1/T3)O( 1 / T^3) for deterministic oracles.

This paper establishes a theoretical foundation for consistency training in diffusion models.

problem Lack of a comprehensive theoretical understanding of consistency training in diffusion models.
method Demonstrates the necessity of a number of steps in consistency learning exceeding d5/2/εd^{5/2}/\varepsilon for generating samples within ε\varepsilon proximity to the target distribution.
result Establishes rigorous insights into the validity and efficacy of consistency models, offering theoretical underpinnings for their utility.

In stochastic gradient descent, especially for neural network training, there are currently dominating first order methods: not modeling local distance to minimum. This information required for optimal step size is provided by second order methods, however, they have many difficulties, starting with full Hessian having…

2019-07-16abs ↗pdf ↗

A new method predicts non-Markovian closure terms for complex systems.

problem Predicting the effect of unresolved variables on resolved dynamics in high-dimensional systems.
method Mamba-Assisted Closure (MAC) framework: sequence model trained to predict closure from resolved trajectory, coupled with reduced-order equations.
result Substantially outperforms existing methods in predictive accuracy and long-time stability.

Improved computational complexity in statistical models using second-order information.

problem Polynomial convergence of gradient descent in singular statistical models.
method Normalized Gradient Descent (NormGD) algorithm with second-order information.
result NormGD reaches final statistical radius in logarithmic iterations of nn.

In order to investigate the origin of large price fluctuations, we analyze stock price changes of ten frequently traded NASDAQ stocks in the year 2002. Though the influence of the trading frequency on the aggregate return in a certain time interval is important, it cannot alone explain the heavy tailed distribution of …

2006-06-18abs ↗pdf ↗

We present a predictor-corrector framework, called PicCoLO, that can transform a first-order model-free reinforcement or imitation learning algorithm into a new hybrid method that leverages predictive models to accelerate policy learning. The new "PicCoLOed" algorithm optimizes a policy by recursively repeating two ste…

2018-10-15abs ↗pdf ↗

A new method helps escape saddle points in non-convex optimization.

problem Escaping saddle points in non-convex optimization problems.
method CNC-SCSG method using a separate SGD step to help escape from strict saddle points.
result The method converges to a second-order stationary point with a rate of O(ε2log(1/ε))O(ε^{-2} log(1/ε)).

Improved SVRG method using BB techniques for faster convergence.

problem Improving the convergence speed of stochastic variance reduction methods.
method Incorporates Barzilai-Borwein (BB) techniques as second-order information into SVRG.
result Proves linear convergence of the proposed method and its variants.

New method solves complex financial option pricing with varying time steps.

problem Pricing American options with varying time steps and regime switching.
method Explicit Runge-Kutta-Fehlberg scheme with fourth-order compact finite difference in space and high order analytical approximation.
result The method provides better performance in terms of computational speed and accuracy.

Time series forecasting with limited data is a challenging yet critical task. While transformers have achieved outstanding performances in time series forecasting, they often require many training samples due to the large number of trainable parameters. In this paper, we propose a training technique for transformers th…

2019-10-21abs ↗pdf ↗

Paper presents a copula-based method to efficiently generate correlated sample paths from multi-step time series models.

problem Generating realistic correlation structures in multi-step forecast sample paths is expensive and time-consuming.
method Copula-based approach to generate correlated sample paths in one forward pass.
result Improved sample path quality and significant speedup over autoregressive sampling.

In this paper, we present an online adaptive PCA algorithm that is able to compute the full dimensional eigenspace per new time-step of sequential data. The algorithm is based on a one-step update rule that considers all second order correlations between previous samples and the new time-step. Our algorithm has O(n) co…

2017-09-07abs ↗pdf ↗

Paper improves CLT and bootstrap approximations for LSA with decreasing step size.

problem Improving normal approximation and bootstrap methods for LSA with decreasing step sizes.
method Refined Berry-Esseen bounds and multiplier bootstrap procedure for LSA.
result Approximation rates up to 1/n1/\sqrt{n} for LSA rescaled error distribution.

Online learning with limited information feedback (bandit) tries to solve the problem where an online learner receives partial feedback information from the environment in the course of learning. Under this setting, Flaxman et al.[8] extended Zinkevich's classical Online Gradient Descent (OGD) algorithm [29] by proposi…

2018-11-25abs ↗pdf ↗

D2SRM solves complex PDEs using deep learning.

problem High-dimensional, Hessian-dependent fully nonlinear parabolic PDEs.
method Single scalar space-time network generating derivative-consistent approximations trained through residuals and penalties.
result Well-posedness and convergence theory established for globally Lipschitz equations.

A fast, accurate method for pricing American options with free boundaries.

problem Pricing American options with free boundaries efficiently and accurately.
method A sixth-order compact finite difference scheme with a dynamic staggered boundary scheme and 3(2) R-K Bogacki-Shampine time stepping.
result An efficient sixth-order compact scheme for pricing American options with free boundaries.

This article presents the further steps of the previously done studies taking into consideration the k-th order extensions of a complex manifold. In the previous studies higher order vertical and complete lifts of structures on the complex manifold were introduced. Presently, k-th extended spaces of a product manifold …

2009-02-28abs ↗pdf ↗

In recent years, deep neural networks have demonstrated outstanding performance in many machine learning tasks. However, researchers have discovered that these state-of-the-art models are vulnerable to adversarial examples: legitimate examples added by small perturbations which are unnoticeable to human eyes. Adversari…

2018-10-08abs ↗pdf ↗

This paper is devoted to a third order study of the end-point map in sub-Riemannian geometry. We first prove third order open mapping results for maps from a Banach space into a finite dimensional manifold. In a second step, we compute the third order term in the Taylor expansion of the end-point map and we specialize …

2019-07-25abs ↗pdf ↗