Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

118236354472 · Jun 202019922001200920172026
48 results for stochastic dimension

Develops robust methods for infinite-dimensional stochastic processes.

problem Measuring covariations in stochastic evolution equations in infinite dimensions.
method Asymptotic theory for jump robust measurement of covariations.
result Identifies scaling limits for realized covariations.

The paper analyzes arbitrage theory in a fluctuating market of stochastic dimension.

problem Arbitrage opportunities in a market with time-varying asset numbers.
method Develops the fundamental theorem of asset pricing and optional decomposition theorem in a stochastic dimension market.
result Equivalence of conditions for no arbitrage and viability in a stochastic dimension market.

Improved loss scaling for stochastic momentum algorithms in high dimensions.

problem Improving loss scaling for stochastic momentum algorithms in high dimensions.
method Dimension-adapted Nesterov acceleration (DANA) scales momentum hyperparameters based on model size and data complexity.
result DANA improves loss scaling exponents across various data and target complexities.

This paper conditions non-linear infinite-dimensional diffusion processes.

problem Conditioning non-linear and infinite-dimensional diffusion processes.
method Infinite-dimensional Girsanov's theorem to condition function-valued stochastic processes.
result Conditioning of non-linear infinite-dimensional diffusion processes is achieved.

Gradient methods struggle with high dimensions in convex optimization.

problem The generalization performance of gradient methods in high-dimensional stochastic convex optimization.
method Construction of learning problems in high dimensions to analyze gradient methods' performance.
result Gradient methods require exponentially more training examples in high dimensions to achieve non-trivial test error.

The paper tackles finding stationary points in stochastic convex optimization problems.

problem Finding stationary points for stochastic convex optimization problems.
method The approach relies on dimension theory to decompose the graph of the subdifferential of a convex function, showing how stochastic sampling preserves 'pieces' of these graphs, and allowing effective application of proximal-point-like methods.
result The paper provides convergence guarantees for finding stationary points in stochastic convex optimization problems.

A new model for sequential prediction handles adversarial examples by allowing abstention.

problem Sequential prediction algorithms fail with adversarial examples, leading to incorrect predictions.
method Proposes a new model that allows abstention from predictions on adversarial examples, scaling error with VC dimension.
result A learner's error scales with the VC dimension of the hypothesis class, matching the stochastic setting.

Study reveals mutual information is crucial for understanding algorithm performance in stochastic convex optimization.

problem Uncertainty in capturing the exceptional performance of learning algorithms using existing information-theoretic generalization bounds.
method Examined the relationship between mutual information and generalization in stochastic convex optimization.
result Mutual information is necessary for true risk minimization in stochastic convex optimization, indicating existing bounds fall short.

A new method speeds up quantum state estimation.

problem Exponential growth in sample size and dimension for quantum state tomography.
method Stochastic mirror descent with Burg entropy.
result Optimization error vanishes at a O((1/t)dlogt)O (\sqrt{ ( 1 / t ) d \log t }) rate.

New method improves stochastic kriging for high-dimensional simulations.

problem High-dimensional simulation models require prohibitive sample sizes and computational costs.
method Tensor Markov kernels and sparse grid experimental designs.
result Sample complexity grows only slightly with dimensionality, improving accuracy and efficiency.

New algorithm optimizes convex functions with noisy evaluations in one dimension.

problem Optimizing convex functions with noisy zero-order evaluations in one dimension.
method Proposed a computationally efficient algorithm achieving O(1/T)O(1/\sqrt{T}) convergence rate.
result Achieved the optimal O(1/T)O(1/\sqrt{T}) convergence rate, closing the gap in one dimension.

Stochastic approximation extended to infinite dimensions, especially Banach spaces.

problem Applying stochastic approximation to infinite-dimensional spaces, particularly Banach spaces.
method Extending stochastic approximation to Banach spaces, including cases like C([0,1],Rd)C([0,1],\mathbb{R}^d) and L1([0,1],Rd)L^1([0,1],\mathbb{R}^d).
result Stochastic approximation can be applied to Banach spaces, including those without the Radon-Nikodym property.

SMAVE optimizes SDR by projecting onto a low-dimensional subspace on a Riemannian manifold.

problem High-dimensional regression challenges due to the curse of dimensionality.
method SMAVE combines nearest-neighbor localization and Riemannian stochastic gradient ascent.
result SMAVE achieves almost-sure convergence and matches RMAVE's synthetic subspace recovery rate.

In this paper, we propose the uncertain volatility models with stochastic bounds. Like the regular uncertain volatility models, we know only that the true model lies in a family of progressively measurable and bounded processes, but instead of using two deterministic bounds, the uncertain volatility fluctuates between …

2017-02-16abs ↗pdf ↗

The paper explores how to reduce classification tasks to optimization problems in Euclidean space.

problem Understanding the minimum dimension needed for reducing classification tasks to optimization problems.
method Developed a generalization of the Borsuk-Ulam Theorem to analyze the expressivity of reductions.
result The minimum Euclidean dimension required can be exponentially larger than the VC dimension, even for slightly non-trivial reductions.

Proposes an online method for high-dimensional streaming data.

problem Increasing variable dimensions with sample size in online kernel sliced inverse regression.
method Introduces approximate linear dependence condition and dictionary variable sets to address the problem. Transforms into online generalized eigen-decomposition problem and uses stochastic optimization for updates.
result Achieves close performance to batch processing kernel sliced inverse regression.

Gradient Langevin dynamics (GLD) and stochastic GLD (SGLD) have attracted considerable attention lately, as a way to provide convergence guarantees in a non-convex setting. However, the known rates grow exponentially with the dimension of the space. In this work, we provide a convergence analysis of GLD and SGLD when t…

2020-02-29abs ↗pdf ↗

New algorithm reduces regret in stochastic bandit convex optimization.

problem Optimizing decisions in uncertain environments with convex losses.
method Introduces a second-order method for zeroth-order stochastic convex bandits.
result Regret bound of (1+r/d)[d1.5n+d3]polylog(n,d,r)(1 + r/d)[d^{1.5} \sqrt{n} + d^3] polylog(n, d, r).

We consider the problem of optimizing a high-dimensional convex function using stochastic zeroth-order queries. Under sparsity assumptions on the gradients or function values, we present two algorithms: a successive component/feature selection algorithm and a noisy mirror descent algorithm using Lasso gradient estimate…

2017-10-29abs ↗pdf ↗

Estimates drift functions in SDEs using denoising diffusion models.

problem Estimating time-homogeneous drift functions in multivariate SDEs.
method Formulates drift estimation as a denoising problem, trains a conditional diffusion model.
result Proposed estimator matches classical methods in low dimensions and remains competitive in higher dimensions.

New theory explains how chaotic training improves neural network generalization.

problem Understanding how chaotic training improves neural network generalization.
method Representing stochastic optimizers as random dynamical systems and introducing a new dimension concept.
result Generalization in chaotic training depends on the complete Hessian spectrum and partial determinants.

Preconditioned gradient methods are among the most general and powerful tools in optimization. However, preconditioning requires storing and manipulating prohibitively large matrices. We describe and analyze a new structure-aware preconditioning algorithm, called Shampoo, for stochastic optimization over tensor spaces.…

2018-02-26abs ↗pdf ↗

The paper studies stochastic optimization on matrices and its limits as dimensions grow.

problem Optimizing functions on large symmetric matrices using stochastic gradient descent.
method Deterministic limits of random curves on matrices, using graphons and stochastic differential equations.
result The limit is a gradient flow on graphons, extending classical McKean-Vlasov limits.

Stochastic gradient descent converges to universal limits in high dimensions.

problem Statistical tasks in high dimensions with specific data projections.
method Stochastic gradient descent applied to mixture distributions, proving universality of limits.
result The ODE limits are universal for mixtures of arbitrary product distributions.

Sliced Inverse Regression reduces parameter space for estimating complex financial models.

problem High-dimensional parameter space in stochastic differential equations.
method Sliced Inverse Regression for dimension reduction.
result Reduced computational costs in estimating parameters.

We describe a method for learning word embeddings with data-dependent dimensionality. Our Stochastic Dimensionality Skip-Gram (SD-SG) and Stochastic Dimensionality Continuous Bag-of-Words (SD-CBOW) are nonparametric analogs of Mikolov et al.'s (2013) well-known 'word2vec' models. Vector dimensionality is made dynamic b…

2015-11-17abs ↗pdf ↗

Paper shows how to use geometric median for robust SGD in high dimensions.

problem Robustifying SGD for high-dimensional optimization problems with gross corruption.
method Applying geometric median to only chosen blocks of coordinates at a time.
result Retains optimal breakdown point of 0.5 for smooth non-convex problems.

Analyzes high-dimensional SGD dynamics using DMFT.

problem Understanding the high-dimensional behavior of multi-pass SGD with small batch sizes.
method Derives DMFT equations for high-dimensional SGD dynamics.
result Proves DMFT equations characterize the asymptotic distribution of SGF parameters.

The paper studies the First Order BSPDEs (Backward Stochastic Partial Differential Equations) suggested earlier for a case of multidimensional state domain with a boundary. These equations represent analogs of Hamilton-Jacobi-Bellman equations and allow to construct the value function for stochastic optimal control pro…

2016-03-22abs ↗pdf ↗