Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

159317476634 · Jun 202019922001200920172026
48 results for stochastic case

New algorithms reduce complexity for solving nonconvex optimization problems with stochastic objectives and constraints.

problem Solving nonconvex optimization problems with stochastic objectives and constraints.
method Single-loop quadratic penalty and augmented Lagrangian algorithms with variance reduction techniques.
result Achieved best-known complexity guarantees for solving nonconvex optimization problems with stochastic objectives and constraints.

We extend Dupire's formula for stochastic interest rates and local volatility.

problem Deriving formulas for stochastic interest rates and local volatility.
method Generalizations of Dupire's formula for stochastic drift and local volatility.
result Validated the limits of the generalized Dupire formulae for specific cases.

New algorithms optimize spectral risk measures, improving interpolation between average and worst-case performance.

problem Optimizing spectral risk measures for learning systems.
method Developed stochastic algorithms to optimize spectral risk measures by characterizing their subdifferential and addressing challenges like biasedness of subgradient estimates and non-smoothness.
result Our approach outperforms out-of-the-box stochastic subgradient and dual averaging methods in optimizing spectral risk measures.

The paper studies stochastic gradient descent with infinite variance gradients.

problem Theoretical properties of SGD with infinite variance gradients.
method Establish asymptotic behavior of SGD with infinite variance gradients.
result Asymptotic distribution of SGD is characterized as a stationary distribution of an Ornstein-Uhlenbeck process driven by a stable Lévy process.

In this paper, we study the behavior of the Hedge algorithm in the online stochastic setting. We prove that anytime Hedge with decreasing learning rate, which is one of the simplest algorithm for the problem of prediction with expert advice, is surprisingly both worst-case optimal and adaptive to the easier stochastic …

2018-09-05abs ↗pdf ↗

Stochastic optimization of continuous objectives is at the heart of modern machine learning. However, many important problems are of discrete nature and often involve submodular objectives. We seek to unleash the power of stochastic continuous optimization, namely stochastic gradient descent and its variants, to such d…

2017-11-05abs ↗pdf ↗

Improves bandits with knapsacks guarantees for partially stochastic workloads.

problem Improves guarantees for Bandits with Knapsacks (BwK) with partially stochastic workloads.
method Defines Approximately Stationary BwK, explores algorithms with smooth competitive ratios transitioning between stochastic and adversarial cases.
result Offers competitive ratios that smoothly transition between the best possible guarantees in stochastic and adversarial cases, especially beneficial when budget is small.

New method assesses financial and cyber risks under uncertainty.

problem Uncertainty in risk assessment for financial and cyber systems.
method Combines stochastic approximation and distorted mix method to compute worst case average value at risk.
result Efficient algorithm for tail uncertainty in multivariate distributions.

New theory explains why normalization is preferred in SGD under heavy-tailed noise.

problem Understanding why normalization is preferred in stochastic gradient descent (SGD) under heavy-tailed noise.
method Developed a worst-case complexity theory for stochastically preconditioned SGD and its variants.
result Normalization guarantees convergence at optimal rates, while clipping may fail in the worst case.

Improved algorithms for stochastic linear bandits using tighter confidence sequences.

problem Stochastic linear bandits with improved worst-case regret guarantees.
method Novel tail bound for adaptive martingale mixtures to construct tighter confidence sequences.
result Linear bandit algorithm achieves competitive worst-case regret.

The existence of stationary Markov perfect equilibria in stochastic games is shown under a general condition called "(decomposable) coarser transition kernels". This result covers various earlier existence results on correlated equilibria, noisy stochastic games, stochastic games with finite actions and state-independe…

2013-11-07abs ↗pdf ↗

Develops methods to simulate option prices for a specific stochastic volatility model.

problem No method exists to compute option prices numerically for a non-martingale jump-type model.
method Develops two Monte Carlo simulation methods under change of measure.
result Conducts numerical experiments to validate the developed methods.

Asymptotic analysis of short-maturity options on realized variance in local-stochastic volatility models.

problem Analyzing the behavior of short-maturity options on realized variance in local-stochastic volatility models.
method Large deviations theory and variational problems to solve rate functions for different cases.
result Explicit solutions for the rate function in the uncorrelated case and upper/lower bounds and expansions for the correlated case.

We introduce and analyze stochastic optimization methods where the input to each gradient update is perturbed by bounded noise. We show that this framework forms the basis of a unified approach to analyze asynchronous implementations of stochastic optimization algorithms.In this framework, asynchronous stochastic optim…

2015-07-24abs ↗pdf ↗

State space models (SSMs) provide a flexible framework for modeling complex time series via a latent stochastic process. Inference for nonlinear, non-Gaussian SSMs is often tackled with particle methods that do not scale well to long time series. The challenge is two-fold: not only do computations scale linearly with t…

2019-01-29abs ↗pdf ↗

New method reveals insights about stochastic optimization methods using modified equations.

problem Understanding the qualitative behavior of stochastic optimization algorithms.
method Developed a class of stochastic differential equations to approximate the dynamics of stochastic optimization methods.
result Mean-square stability of the modified equation provides qualitative insights about stochastic coordinate descent.

We consider the stochastic nested composition optimization problem where the objective is a composition of two expected-value functions. We proposed the stochastic ADMM to solve this complicated objective. In order to find an εε stationary point where the expected norm of the subgradient of corresponding augmented Lag…

2019-11-12abs ↗pdf ↗

Study efficient algorithms for nonconvex optimization with state-dependent Markov data.

problem Stochastic optimization with Markovian data and state-dependent transition kernels.
method Projection-based and projection-free algorithms for constrained nonconvex problems.
result The number of oracle calls to achieve an εε-stationary point is O(1/ε2.5)\mathcal{O}(1/ε^{2.5}).

Stochastic gradient descent is a simple approach to find the local minima of a cost function whose evaluations are corrupted by noise. In this paper, we develop a procedure extending stochastic gradient descent algorithms to the case where the function is defined on a Riemannian manifold. We prove that, as in the Eucli…

2011-11-22abs ↗pdf ↗

In this paper, we propose the uncertain volatility models with stochastic bounds. Like the regular uncertain volatility models, we know only that the true model lies in a family of progressively measurable and bounded processes, but instead of using two deterministic bounds, the uncertain volatility fluctuates between …

2017-02-16abs ↗pdf ↗

Stochastic approximation extended to infinite dimensions, especially Banach spaces.

problem Applying stochastic approximation to infinite-dimensional spaces, particularly Banach spaces.
method Extending stochastic approximation to Banach spaces, including cases like C([0,1],Rd)C([0,1],\mathbb{R}^d) and L1([0,1],Rd)L^1([0,1],\mathbb{R}^d).
result Stochastic approximation can be applied to Banach spaces, including those without the Radon-Nikodym property.

The purpose of this work is to extend the formalism of stochastic calculus to the case of spaces with local anisotropy (modeled as vector bundles with compatible nonlinear and distinguished connections and metric structures and containing as particular cases different variants of Kaluza--Klein and generalized Lagrange …

1996-04-05abs ↗pdf ↗

In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that noisy information about the gradients of the objective function is available via a stochastic first-order oracle (SFO). We propose a general framework for such methods, for which we prove almost sure conve…

2016-07-05abs ↗pdf ↗

The study extends stochastic completeness to landmark spaces with any number of landmarks.

problem Stochastic completeness for landmark spaces with arbitrary numbers of landmarks.
method Volume growth criterion and eigenvalue bounds for geodesic balls.
result Stochastic completeness for landmark spaces with any number of landmarks is proven.

In this paper, we study and analyze the mini-batch version of StochAstic Recursive grAdient algoritHm (SARAH), a method employing the stochastic recursive gradient, for solving empirical loss minimization for the case of nonconvex losses. We provide a sublinear convergence rate (to stationary points) for general noncon…

2017-05-20abs ↗pdf ↗

New methods optimize complex optimization problems with improved efficiency.

problem Optimizing complex problems with a convex lower-level objective.
method Uses stochastic cutting planes and conditional gradient updates.
result Improves complexity for both convex and non-convex upper-level functions.

We propose a stochastic gradient Markov chain Monte Carlo (SG-MCMC) algorithm for scalable inference in mixed-membership stochastic blockmodels (MMSB). Our algorithm is based on the stochastic gradient Riemannian Langevin sampler and achieves both faster speed and higher accuracy at every iteration than the current sta…

2015-10-16abs ↗pdf ↗

In this paper we established the condition for a curve to satisfy stochas- tic fractional HP (Hamilton-Pontryagin) equations. These equations are described using It^o integral. We have also considered the case of stochastic fractional Hamiltonian equa- tions, for a hyperregular Lagrange function. From the stochastic fr…

2009-06-24abs ↗pdf ↗

Paper develops SINNOs for approximating stochastic processes.

problem Approximating stochastic processes with neural networks.
method Developed stochastic interpolation neural network operators (SINNOs) with random coefficients.
result Established boundedness, interpolation accuracy, and approximation capabilities of SINNOs.

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and the objective function. Since the problem has unbounded domain, the objective func…

2019-09-16abs ↗pdf ↗

Optimizes regret distribution in stochastic bandits for risk balance.

problem Balancing regret expectation and tail risk in stochastic bandits.
method Characterizes optimal regret tail probability for any threshold, proposes new policies.
result Discovers an intrinsic gap in optimal tail rate based on time horizon uncertainty.

Adaptive MAB algorithms handle composite, anonymous feedback without reward interval knowledge.

problem Multi-armed bandit with composite and anonymous feedback, especially without reward interval size knowledge.
method Proposed adaptive algorithms for stochastic and adversarial cases, without reward interval knowledge.
result First algorithm for adversarial case handling non-oblivious adversary and unknown reward interval size.

Stochastic approximation proves asymptotic normality for non-smooth problems.

problem Solving non-smooth stochastic approximation problems.
method Stochastic approximation algorithms for solving smooth equations, extended to non-smooth problems.
result Asymptotic normality and optimality in non-smooth stochastic approximation is proven.