The paper develops algorithms for computing in stochastic acceptors.
problem Computing input marginals and acceptance probabilities in stochastic acceptors.
method Dynamic programming for input marginals, EM for parameter estimation.
result Efficient algorithms for computing in stochastic acceptors.
We prove that the exponential growth rate of the regular language of penetration sequences is smaller than the growth rate of the regular language of normal form words, if the acceptor of the regular language of normal form words is strongly connected. Moreover, we show that the latter property is satisfied for all irr…
The paper analyzes sterling bills of exchange during the first globalization, revealing their global financial role.
problem Understanding the global financial role of sterling bills of exchange during the first globalization.
method Descriptive statistics and network analysis of a unique data set of 23,493 bills re-discounted by the Bank of England in 1906.
result Sterling bills of exchange had a truly global dimension and were crucial for overcoming information asymmetries.
Molecular structure-property relationships are key to molecular engineering for materials and drug discovery. The rise of deep learning offers a new viable solution to elucidate the structure-property relationships directly from chemical data. Here we show that the performance of graph convolutional networks (GCNs) for…
Gryffin optimizes categorical variables in materials design, leveraging expert knowledge.
problem Optimizing categorical variables in complex design choices like molecule selection.
method Bayesian optimization with smooth approximations to categorical distributions, incorporating expert knowledge.
result Gryffin accelerates discovery of promising molecules and materials, highlighting relevant correlations.
Paper corrects and expands stochastic Lie systems theory.
problem Stochastic Lie systems and their properties.
method Corrected stochastic Lie theorem, introduced new stochastic Lie systems.
result Stochastic Lie systems can differ significantly between Stratonovich and Itô approaches.
The study analyzes stochastic Lie systems and their applications in various models.
problem Analyzing stochastic differential equations on manifolds.
method Coalgebra method for Hamiltonian stochastic Lie systems.
result New examples of stochastic Lie systems and Hamiltonian stochastic Lie systems are analyzed.
sFML learns stochastic dynamical systems from data.
problem Learning unknown stochastic dynamical systems from measurement data.
method sFML extends FML for deterministic systems, using a stochastic flow map composed of deterministic and stochastic sub-maps.
result sFML constructs a stochastic evolution model approximating unknown stochastic systems.
Unified framework connects stochastic optimization to Bayesian inference.
problem Stochastic optimization algorithms and their theoretical underpinnings.
method Latent variational problem and Forward Backward Stochastic Differential Equations (FBSDE).
result Recovery of various adaptive stochastic gradient descent methods.
Develops mathematical framework for analyzing stochastic gradient algorithms.
problem Analyzing the dynamics of stochastic gradient algorithms.
method Stochastic modified equations (SME) framework to approximate stochastic gradient algorithms as stochastic differential equations.
result Proves that the approximation leads to precise results on SGD, momentum SGD, and Nesterov's accelerated gradient method.
The existence of stationary Markov perfect equilibria in stochastic games is shown under a general condition called "(decomposable) coarser transition kernels". This result covers various earlier existence results on correlated equilibria, noisy stochastic games, stochastic games with finite actions and state-independe…
Bayesian neural networks can be partially stochastic without losing predictive power.
problem The necessity of fully stochastic parameters in Bayesian neural networks.
method Theoretical and empirical investigation of partially stochastic networks compared to fully stochastic ones.
result Expressive predictive distributions require only small amounts of stochasticity, and partially stochastic networks can match or outperform fully stochastic networks.
Stochastic approximation algorithms show exponential progress bounds.
problem Analyzing the convergence of stochastic approximation algorithms.
method Developed geometric ergodicity proofs to establish exponential concentration bounds.
result Proved faster convergence rates for specific algorithms.
Stochastic gradient methods can converge in expectation under heavy-tailed noise.
problem Convergence of stochastic gradient methods under heavy-tailed noise.
method Comprehensive study of stochastic optimization under heavy-tailed noise for extsfSGD, extsfSMD, extsfASMD, extsfSGDM in convex and nonconvex optimization. result Established in-expectation convergence results for various stochastic gradient methods.
Study on stochastic mean curvature flow on networks using Ito calculus.
problem Understanding the dynamics of network structures under random influences.
method Application of Ito calculus to derive a stochastic differential equation (SDE) for network edges.
result New insights into the stability, long-term behavior, and pattern formation of complex networks under stochastic influences.
New method reveals insights about stochastic optimization methods using modified equations.
problem Understanding the qualitative behavior of stochastic optimization algorithms.
method Developed a class of stochastic differential equations to approximate the dynamics of stochastic optimization methods.
result Mean-square stability of the modified equation provides qualitative insights about stochastic coordinate descent.
New method uses backward SDEs for deep learning uncertainty.
problem Uncertainty quantification in deep learning models.
method Probabilistic machine learning with stochastic neural networks and stochastic optimal control.
result Effectiveness validated through numerical experiments.
We extend Dupire's formula for stochastic interest rates and local volatility.
problem Deriving formulas for stochastic interest rates and local volatility.
method Generalizations of Dupire's formula for stochastic drift and local volatility.
result Validated the limits of the generalized Dupire formulae for specific cases.
The article reviews how to set stochastic volatility model parameters.
problem Choosing parameters for stochastic volatility models.
method Examines existing literature on various methods.
result Different approaches to setting stochastic volatility parameters.
This paper studies a non-stochastic version of Fernholz's stochastic portfolio theory for a simple model of stock markets with continuous price paths. It establishes non-stochastic versions of the most basic results of stochastic portfolio theory and discusses connections with Stroock-Varadhan martingales.
New theorem handles stochastic Volterra semimartingales.
problem Classic Fubini theorem restrictions for Volterra semimartingales.
method Introduced measure-valued stochastic integration.
result Proved new stochastic Fubini theorem.
Proposes a new method combining Reservoir Computing and Normalizing Flow for predicting stochastic dynamical systems.
problem Predicting and capturing long-term behaviors of stochastic dynamical systems.
method Data-driven framework combining Reservoir Computing and Normalizing Flow, integrating error modeling and both approaches virtues.
result Successfully predicts the long-term evolution of stochastic dynamical systems and replicates dynamical behaviors.
Proposes new Monte Carlo methods for calibrating local volatility models with stochastic components.
problem Calibrating local volatility models with stochastic drift and diffusion.
method Developed Monte Carlo algorithms for three models: local volatility with stochastic interest rates, stochastic local volatility with deterministic interest rates, and stochastic local volatility with stochastic interest rates.
result Conditions for the existence of local volatility given European option prices, stochastic interest rate model parameters, and correlations.
We introduce a stochastic model for noisy vector fields on manifolds.
problem Noisy vector fields violate the assumption of parallel transport in stochastic analysis.
method We define a stochastic Lie bracket that induces torsion and analyze its consequences.
result The stochastic Lie bracket induces torsion in expectation.
New dynamics for SGD in small learning rate regime.
problem Improving stochastic gradient descent in small learning rate regime.
method Introducing stochastic modified flows and distribution dependent stochastic modified flows.
result Captures fluctuating dynamics of SGD in small learning rate - infinite width scaling regime.
Survey of methods for solving smooth stochastic variational inequalities.
problem Solving smooth (strongly) monotone stochastic variational inequalities.
method Deterministic foundation, general stochastic formulation, finite sum setup, recent advances.
result Review of various methods for solving smooth stochastic variational inequalities.
Study exchange option pricing with stochastic volatility and correlation.
problem Pricing exchange options under stochastic volatility and correlation.
method Approximation using a closed-form solution with Taylor expansion.
result Numerical results show the effectiveness of the proposed method.
The paper connects higher order risk measures and stochastic dominance, showing their equivalence and integrating them with optimization.
problem Comparing and characterizing random outcomes in risk assessment.
method Exploring the equivalence between higher order risk measures and stochastic dominance, using stochastic optimization and expectiles as examples.
result Higher order risk measures and stochastic dominance are equivalent and can be used to characterize random outcomes.
A new family of stochastic dominance orders based on distortion functions.
problem Determining a continuum of dominance relations for risk assessment.
method Introducing H-distorted stochastic dominance, a generalized family of stochastic orders.
result Power-distorted stochastic dominance is particularly appealing due to its simplicity and statistical interpretations.
New method efficiently computes gradients for stochastic differential equations.
problem Computing gradients for stochastic differential equations efficiently.
method Generalized adjoint sensitivity method to stochastic differential equations.
result Time-efficient and memory-efficient computation of gradients with high-order solvers.
Stochastic programs simplify complex models with noise and nondeterminism.
problem Handling models with nuisance parameters, noise, and nondeterminism.
method Developed a reference implementation for stochastic probabilistic programs and inference.
result Efficient inference in models with noise and nondeterminism is possible.
In this paper, we propose a novel technique to implement stochastic gradient methods, which are beneficial for learning from large datasets, through accelerated stochastic dynamics. A stochastic gradient method is based on mini-batch learning for reducing the computational cost when the amount of data is large. The sto…
Algorithm samples constrained stochastic differential equations.
problem Sampling stochastic differential equations with complex constraints.
method Pathspace Metropolis-adjusted manifold sampling.
result Demonstrated effectiveness in various constrained conditions.
New algorithm solves stochastic optimization problems with unknown gradients.
problem Solving nonlinear optimization problems with stochastic objectives and deterministic constraints.
method Adaptive SQP with differentiable exact augmented Lagrangian and stochastic line search.
result Global convergence established for both non-adaptive and adaptive SQP methods.
Paper uses second-order differential geometry to study stochastic mechanics.
problem Stochastic differential equations and their symmetries.
method Develops second-order differential geometry to study symmetries of SDEs and constructs stochastic mechanics.
result Establishes stochastic Lagrangian and Hamiltonian mechanics and their relations with HJB equations.
We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete or continuous distribution over random matrices. Our reformulation has several e…
We develop the method of stochastic modified equations (SME), in which stochastic gradient algorithms are approximated in the weak sense by continuous-time stochastic differential equations. We exploit the continuous formulation together with optimal control theory to derive novel adaptive hyper-parameter adjustment po…
Bayesian inference using stochastic neural networks ensembles.
problem Approximating Bayesian posterior distributions.
method Formulate stochastic ensembles of neural networks, train with variational inference, and evaluate using Monte Carlo dropout.
result Stochastic ensembles provide more accurate posterior estimates than other methods.
High-probability bound for distributed stochastic approximation tracking error.
problem Analyzing the convergence of distributed stochastic approximation schemes.
method Analysis using ODE approach to stochastic approximation.
result High probability bound for tracking error between iterates and limiting differential equation.
This paper extends Heston's SV model to include stochastic interest rates.
problem Modeling options with stochastic interest rates.
method Developed a new SV model with stochastic interest rates and derived a semi-explicit formula.
result Derived a semi-explicit formula for option pricing with stochastic interest rates.
Simplified calculus for semimartingales makes complex transformations easier.
problem Complex transformations of semimartingales.
method Unified treatment of transformations for real and complex semimartingales.
result Unified calculus for semimartingales simplifies various transformations.
In this paper, we consider multi-stage stochastic optimization problems with convex objectives and conic constraints at each stage. We present a new stochastic first-order method, namely the dynamic stochastic approximation (DSA) algorithm, for solving these types of stochastic optimization problems. We show that DSA c…
Stochastic gradient descent on manifolds improves low-rank approximation.
problem Efficiently approximate large matrices with lower rank.
method Stochastic gradient descent on a manifold.
result Algorithm outperforms Euclidean space methods on Netflix Prize data.
Corrects a mistake in a proof about large portfolios of stochastic volatility models.
problem Problems with a proof in a paper about large portfolios of stochastic volatility models.
method Reestablishes a weaker version of Theorem 3.1 and redevelops regularity theory.
result Most regularity results are replaced by slightly weaker ones.
Neural networks can approximate complex stochastic equations well.
problem Approximating general stochastic differential equations.
method Identified neural network classes approximating continuous functions.
result Neural stochastic differential equations can approximate general stochastic differential equations arbitrarily well.
SON learns SPDE solutions and uncertainty from noisy data.
problem Uncertainty quantification in SPDEs with unknown model uncertainties.
method Combining DeepONet and SNNs, SON models stochasticity and predicts uncertainty.
result SON accurately captures solution structure and quantifies predictive uncertainty.
We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for asymptotic optimality of standard stochastic gradient procedures. Roughly, the n…
New algorithm improves on EM for streaming data, outperforming existing methods.
problem Processing high-volume, streaming data efficiently.
method Incremental stochastic Majorization-Minimization (MM) algorithm.
result The algorithm converges to a stationary point with vanishing gradient.