The paper examines conditions for stochastic invariance of cones in SPDEs with jumps.
problem Stochastic invariance of cones in SPDEs with jumps.
method Sufficient conditions for stochastic invariance of closed convex cones in abstract L2-spaces. result Conditions for stochastic invariance of cones are provided and analyzed.
Study shows how certain stochastic models reach a steady state over time.
problem Understanding long-term behavior of stochastic volatility models.
method Novel coupling technique for Markov chains, applicable to random environments.
result Convergence to an invariant measure for multidimensional fractional models.
SGD tends to favor simpler subnetworks, improving generalization.
problem SGD's tendency to favor simpler subnetworks over complex ones.
method Identifying invariant sets and analyzing SGD's behavior around them.
result SGD collapses networks to simpler subnetworks, improving generalization.
Improves full conformal prediction for stochastic non-conformity measures.
problem Inability of existing conditions to guarantee full conformal prediction validity under stochastic settings.
method Introduces a new sufficient condition: Conditional Independence & Permutation Invariance in Distribution.
result Corrects the insufficient condition and provides a new sufficient condition for full conformal prediction validity.
Efficiently simulates slow dynamics of high-dimensional stochastic systems.
problem Simulating high-dimensional stochastic systems with slow dynamics and fast modes.
method Designs an algorithm to estimate an invariant manifold and its dynamics, averaging out fast modes.
result Efficient simulator of effective dynamics on low-dimensional invariant manifold.
Paper derives an error bound for stochastic LTI systems.
problem Stochastic LTI systems with inputs in control engineering and econometrics.
method PAC-Bayesian-Like error bound derivation.
result Derived an error bound for stochastic LTI systems.
Paper approximates risk measures using SGD with Langevin dynamics.
problem Approximating arbitrary law invariant risk measures.
method Stochastic Gradient Langevin Dynamics (SGD-Langevin) for general risk measures.
result Non-asymptotic convergence rates of the approximation algorithm.
SETrLUSI combines diverse knowledge from multiple domains for faster convergence.
problem Handling diverse knowledge from multiple domains in transfer learning.
method Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI).
result SETrLUSI accelerates convergence and outperforms related methods.
Study on convergence of SDEs using entropy methods.
problem Analyzing convergence of stochastic differential equations.
method Applied Lyapunov method to Fokker-Planck equation with weighted relative Fisher information.
result Exponential convergence of probability density function to invariant distribution in L1 distance. We make policy optimization algorithms batch size-invariant by decoupling proximal and behavior policies.
problem Some policy optimization algorithms do not have batch size-invariance, leading to inefficiencies.
method We decouple the proximal policy from the behavior policy to achieve batch size-invariance.
result Our approach makes policy optimization algorithms more efficient and allows them to use stale data more effectively.
A new biased gradient descent method for conditional stochastic optimization.
problem Challenges in constructing unbiased gradient estimators for conditional stochastic optimization.
method Proposes a biased stochastic gradient descent (BSGD) algorithm and analyzes its sample complexities.
result Establishes sample complexities of BSGD for various objectives and shows that BSpiderBoost matches the lower bound complexity.
In this article we present an intrinsec construction of foliated Brownian motion via stochastic calculus adapted to foliation. The stochastic approach together with a proposed foliated vector calculus provide a natural method to work on harmonic measures. Other results include a decomposition of the Laplacian in terms …
A framework learns multiscale dynamics from single trajectories using normalizing flows.
problem Learning effective stochastic dynamics from single observed paths of slow variables.
method Data-driven approach based on coupled multiscale SDEs, stochastic averaging, and normalizing flows for density modeling.
result Scalable approach to capturing epistemic uncertainty in multiscale systems.
This paper uses SDEs to analyze GANs training and long-run behavior.
problem Understanding the training process and long-run behavior of GANs.
method Established SDE approximations for GANs training and analyzed long-run behavior via invariant measures.
result The long-run behavior of GANs training can be studied via the invariant measures of its SDE approximations.
Study links fractal structure to generalization in stochastic optimization.
problem Understanding generalization in stochastic optimization algorithms.
method Represented stochastic optimization algorithms as random iterated function systems (IFS) and used dynamical systems theory.
result Proved that generalization error can be bounded based on fractal structure of invariant measure.
Unified framework for image restoration using equivariant denoisers.
problem Restoring images with realistic priors and invariant transformations.
method Unified framework named ERED based on equivariant denoisers and stochastic optimization.
result Unified framework ERED converges and improves image restoration.
In this paper, we quantitative convergence in W2 for a family of Langevin-like stochastic processes that includes stochastic gradient descent and related gradient-based algorithms. Under certain regularity assumptions, we show that the iterates of these stochastic processes converge to an invariant distribution at a…
We consider three different approaches to define natural Riemannian metrics on polytopes of stochastic matrices. First, we define a natural class of stochastic maps between these polytopes and give a metric characterization of Chentsov type in terms of invariance with respect to these maps. Second, we consider the Fish…
Study on pairwise counter-monotonicity, a type of negative dependence.
problem Understanding and quantifying extremal negative dependence structures.
method Established stochastic representation and invariance property; showed implications and connections.
result Pairwise counter-monotonicity implies negative association and joint mix dependence.
The paper derives the QGS equations using stochastic central extensions.
problem Deriving the viscous quasi-geostrophic equations on the torus.
method Central extensions of Lie groups and Lie algebras, stochastic Lagrangian formulation, and Euler-Poincaré reduction.
result Stochastic perturbations to the central extension lead to solutions of the QGS equations.
This work learns effective dynamics from short-term data of stochastic systems.
problem Learning effective dynamics from short-term data of stochastic systems.
method Proposes a novel algorithm using a neural network (Auto-SDE) to learn invariant slow manifold from data.
result Validated through numerical experiments to be accurate, stable, and effective.
Stochastic Gradient Langevin Dynamics (SGLD) has emerged as a key MCMC algorithm for Bayesian learning from large scale datasets. While SGLD with decreasing step sizes converges weakly to the posterior distribution, the algorithm is often used with a constant step size in practice and has demonstrated successes in mach…
Recent advances in Bayesian learning with large-scale data have witnessed emergence of stochastic gradient MCMC algorithms (SG-MCMC), such as stochastic gradient Langevin dynamics (SGLD), stochastic gradient Hamiltonian MCMC (SGHMC), and the stochastic gradient thermostat. While finite-time convergence properties of th…
A new model encodes distances and topology in latent variables.
problem Modeling dissimilarity data with latent variables and invariances.
method Isometric Gaussian Process Latent Variable Model using Riemannian geometry and variational inference.
result The model can encode invariances in learned manifolds.
DICE learns population dynamics from discrete samples.
problem Learning smooth population dynamics from discrete data.
method Discrete Inverse Continuity Equation (DICE) method.
result DICE models are stable and generate representative samples.
Regularizes RNNs to be invariant to input order.
problem Making RNNs invariant to input order.
method Stochastic regularization to enforce permutation invariance.
result Improves model performance on permutation invariant tasks.
Derives stochastic and dissipative dynamics preserving Gibbs measure.
problem Understanding and deriving structure-preserving stochastic systems.
method Extension of Hamilton-Pontryagin principle, symmetry reduction, and inclusion of dissipation.
result New derivation of double-bracket dissipation.
Investigates spectral properties of neural networks, showing invariance under certain conditions.
problem Understanding the spectral evolution and invariance in linear-width neural networks.
method Empirical and theoretical analysis of spectra of weight matrices in high-dimensional settings.
result Spectra of weight matrices are invariant under certain training conditions, with implications for feature learning.
We develop a scale-invariant truncated Lévy (STL) process to describe physical systems characterized by correlated stochastic variables. The STL process exhibits Lévy stability for the probability density, and hence shows scaling properties (as observed in empirical data); it has the advantage that all moments are fini…
We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and state-dependent and the potential function can be non-convex. We show that the key p…
We establish general versions of a variety of results for quasiconvex, lower-semicontinuous, and law-invariant functionals. Our results extend well-known results from the literature to a large class of spaces of random variables. We sometimes obtain sharper versions, even for the well-studied case of bounded random var…
Study optimizes growth rate for investors with long-only constraints.
problem Maximizing growth rate under drift uncertainty and long-only constraints.
method Developed a finite dimensional approximation for concave functionally generated portfolios.
result Proved uniqueness and existence for optimal portfolios under long-only constraints.
In this paper, we prove the existence of martingale solutions to the stochastic heat equation taking values in a Riemannian manifold, which admits Wiener (Brownian bridge) measure on the Riemannian path (loop) space as an invariant measure using a suitable Dirichlet form. Using the Andersson-Driver approximation, we he…
Let G be a Lie Group with a left invariant connection such that its connection function is skew-symmetric. Our main goal is to show a version of Pluzhnikov's Theorem for this kind of connection. To this end, we use the stochastic logarithm. More exactly, the stochastic logarithm gives characterizations for Brownian m…
Spectral portfolio theory links neural networks to wealth dynamics via SGD weight matrices.
problem Understanding wealth dynamics from neural network training.
method Direct identification of weight matrices as portfolio allocation matrices, linking SGD forces to portfolio dynamics.
result Spectral properties of SGD weight matrices transition between additive and multiplicative regimes, influencing wealth dynamics.
Characterizes geodesic completeness for landmark spaces.
problem Ensuring geodesics exist for all times in landmark spaces.
method Integrability criterion based on cometric kernel behavior.
result Full characterization of geodesic completeness for smooth Riemannian metrics.
In reinforcement learning episodes, the rewards and punishments are often non-deterministic, and there are invariably stochastic elements governing the underlying situation. Such stochastic elements are often numerous and cannot be known in advance, and they have a tendency to obscure the underlying rewards and punishm…
We propose a correlated stochastic process of which the novel non-Gaussian probability mass function is constructed by exactly solving moment generating function. The calculation of cumulants and auto-correlation shows that the process is convergent and scale invariant in the large but finite number limit. We demonstra…
New model improves field learning with improved equivariance.
problem Learning equivariant stochastic fields.
method Equivariant Gaussian processes and Steerable Conditional Neural Processes.
result SteerCNPs significantly improve performance in transfer learning tasks.
Paper extends a method to estimate Hurst parameter for rough stochastic volatility models.
problem Estimating Hurst parameter of rough stochastic volatility models from discrete observations.
method Extends a scale-invariant estimator to a general nonlinear function.
result Consistent estimation of Hurst parameter for a wide class of rough stochastic volatility models.
Gauge symmetries explain the emergence of Merton-Garman equation from Black-Scholes in finance.
problem Understanding the emergence of Merton-Garman equation from Black-Scholes in financial markets.
method Using Hamiltonian formulation and gauge symmetry to derive the Merton-Garman equation from Black-Scholes, analyzing the role of stochastic volatility.
result Gauge symmetry explains the appearance of stochastic volatility and its massivation via the Higgs mechanism.
We study existence and uniqueness of continuous-time stochastic Radner equilibria in an incomplete market model among a group of agents whose preference is characterized by cash invariant time-consistent monetary utilities. An assumption of "smallness" type is shown to be sufficient for existence and uniqueness. In par…
While stochastic gradient descent (SGD) and variants have been surprisingly successful for training deep nets, several aspects of the optimization dynamics and generalization are still not well understood. In this paper, we present new empirical observations and theoretical results on both the optimization dynamics and…
We introduce a multivariate stochastic volatility model for asset returns that imposes no restrictions to the structure of the volatility matrix and treats all its elements as functions of latent stochastic processes. When the number of assets is prohibitively large, we propose a factor multivariate stochastic volatili…
It is well known that neural networks with rectified linear units (ReLU) activation functions are positively scale-invariant. Conventional algorithms like stochastic gradient descent optimize the neural networks in the vector space of weights, which is, however, not positively scale-invariant. This mismatch may lead to…
This work studies nonnegativity-preserving kernels for stochastic equations and their applications.
problem Nonnegativity preservation in stochastic Volterra equations and related processes.
method Characterization and application of completely monotone kernels; approximation schemes for weak error.
result Positive linear combinations of decaying exponentials can be used for second-order approximation schemes.
Time reversal invariance can be summarized as follows: no difference can be measured if a sequence of events is run forward or backward in time. Because price time series are dominated by a randomness that hides possible structures and orders, the existence of time reversal invariance requires care to be investigated. …
The study extends stochastic completeness to landmark spaces with any number of landmarks.
problem Stochastic completeness for landmark spaces with arbitrary numbers of landmarks.
method Volume growth criterion and eigenvalue bounds for geodesic balls.
result Stochastic completeness for landmark spaces with any number of landmarks is proven.