Optimizes random forest inference by defining step order to maximize accuracy.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Negative step sizes improve second-order methods for neural networks.
The second order method as Newton Step is a suitable technique in Online Learning to guarantee regret bound. The large data is a challenge in Newton method to store second order matrices as hessian. In this paper, we have proposed an modified online Newton step that store first and second order matrices of dimension m …
Improved solver maintains positivity and accuracy across all time steps.
NMC improves MCMC convergence by analyzing gradients to determine optimal proposal densities.
A two-step nonparametric method estimates financial systemic risk.
Optimistic method adapted for faster convex-concave min-max problems.
A higher-order Runge-Kutta optimizer performs poorly compared to Adam when evaluated fairly.
The mean-field variant of the model of limit order driven market introduced recently by Maslov is formulated and solved. The agents do not have any strategies and the memory of the system is kept within the order book. We show that he evolution of the order book is governed by a matrix multiplicative process. The resul…
New method solves stochastic optimization problems with random models.
We present a new microscopic stochastic model for an ensemble of interacting investors that buy and sell stocks in discrete time steps via limit orders based on individual forecasts about the price of the stock. These orders determine the supply and demand fixing after each round (time step) the new price of the stock …
In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be approximated by stochastic oracles. The proposed method combines general stochastic …
Enhances CEV model pricing with high-order scheme and adaptive time stepping.
Study improves BN TTA under distribution shift using higher-order asymptotics.
Paper proposes a new method for efficient second-order neural network training.
LOBDIF predicts limit order book events using a diffusion model.
In this paper, we study stochastic non-convex optimization with non-convex random functions. Recent studies on non-convex optimization revolve around establishing second-order convergence, i.e., converging to a nearly second-order optimal stationary points. However, existing results on stochastic non-convex optimizatio…
A new method for faster optimization of noisy functions.
GD with large, adaptive stepsizes achieves optimal risk in logistic regression.
This paper establishes a theoretical foundation for consistency training in diffusion models.
In stochastic gradient descent, especially for neural network training, there are currently dominating first order methods: not modeling local distance to minimum. This information required for optimal step size is provided by second order methods, however, they have many difficulties, starting with full Hessian having…
A new method predicts non-Markovian closure terms for complex systems.
Improved computational complexity in statistical models using second-order information.
Second-order estimator improves continuous-time policy evaluation.
New adaptive step-size method for convex optimization without tuning.
In order to investigate the origin of large price fluctuations, we analyze stock price changes of ten frequently traded NASDAQ stocks in the year 2002. Though the influence of the trading frequency on the aggregate return in a certain time interval is important, it cannot alone explain the heavy tailed distribution of …
We present a predictor-corrector framework, called PicCoLO, that can transform a first-order model-free reinforcement or imitation learning algorithm into a new hybrid method that leverages predictive models to accelerate policy learning. The new "PicCoLOed" algorithm optimizes a policy by recursively repeating two ste…
Maps in Carnot groups are equivalent to solutions of a PDE system.
We consider the dynamics of a linear stochastic approximation algorithm driven by Markovian noise, and derive finite-time bounds on the moments of the error, i.e., deviation of the output of the algorithm from the equilibrium point of an associated ordinary differential equation (ODE). We obtain finite-time bounds on t…
A complete error analysis of variational integrators is obtained, by blowing up the discrete variational principles, all of which have a singularity at zero time-step. Divisions by the time step lead to an order that is one less than observed in simulations, a deficit that is repaired with the help of a new past-future…
A new method helps escape saddle points in non-convex optimization.
This paper is concerned with the problems of interaction screening and nonlinear classification in a high-dimensional setting. We propose a two-step procedure, IIS-SQDA, where in the first step an innovated interaction screening (IIS) approach based on transforming the original -dimensional feature vector is propose…
Improved SVRG method using BB techniques for faster convergence.
New method solves complex financial option pricing with varying time steps.
New method improves model risk prediction using cross-audit projection.
Time series forecasting with limited data is a challenging yet critical task. While transformers have achieved outstanding performances in time series forecasting, they often require many training samples due to the large number of trainable parameters. In this paper, we propose a training technique for transformers th…
One-step diffusion samplers reduce sampling time and computational costs.
Paper presents a copula-based method to efficiently generate correlated sample paths from multi-step time series models.
In this paper, we present an online adaptive PCA algorithm that is able to compute the full dimensional eigenspace per new time-step of sequential data. The algorithm is based on a one-step update rule that considers all second order correlations between previous samples and the new time-step. Our algorithm has O(n) co…
Paper improves CLT and bootstrap approximations for LSA with decreasing step size.
Online learning with limited information feedback (bandit) tries to solve the problem where an online learner receives partial feedback information from the environment in the course of learning. Under this setting, Flaxman et al.[8] extended Zinkevich's classical Online Gradient Descent (OGD) algorithm [29] by proposi…
This paper provides a block coordinate descent algorithm to solve unconstrained optimization problems. In our algorithm, computation of function values or gradients is not required. Instead, pairwise comparison of function values is used. Our algorithm consists of two steps; one is the direction estimate step and the o…
D2SRM solves complex PDEs using deep learning.
A fast, accurate method for pricing American options with free boundaries.
We propose a new high-order alternating direction implicit (ADI) finite difference scheme for the solution of initial-boundary value problems of convection-diffusion type with mixed derivatives and non-constant coefficients, as they arise from stochastic volatility models in option pricing. Our approach combines differ…
This article presents the further steps of the previously done studies taking into consideration the k-th order extensions of a complex manifold. In the previous studies higher order vertical and complete lifts of structures on the complex manifold were introduced. Presently, k-th extended spaces of a product manifold …
In recent years, deep neural networks have demonstrated outstanding performance in many machine learning tasks. However, researchers have discovered that these state-of-the-art models are vulnerable to adversarial examples: legitimate examples added by small perturbations which are unnoticeable to human eyes. Adversari…
This paper is devoted to a third order study of the end-point map in sub-Riemannian geometry. We first prove third order open mapping results for maps from a Banach space into a finite dimensional manifold. In a second step, we compute the third order term in the Taylor expansion of the end-point map and we specialize …