Develops a new theory for neural systems stability and width effects.
problem Stability and finite-width effects in deep neural systems.
method Gauge-covariant stochastic effective field theory using classical commuting fields.
result Predicts the edge of chaos and low-frequency spectral deformation.
Analysis of SGD for Gaussian mixture classification using dynamical mean-field theory.
problem Learning dynamics of SGD for a neural network classifying Gaussian mixture.
method Applying dynamical mean-field theory to track SGD dynamics in high dimensions.
result Reveals how SGD navigates the non-convex loss landscape.
In a recent formulation of a quantum field theory of forward rates, the volatility of the forward rates was taken to be deterministic. The field theory of the forward rates is generalized to the case of stochastic volatility. Two cases are analyzed, firstly when volatility is taken to be a function of the forward rates…
Stochastic normalizing flows improve lattice field theory simulations.
problem Efficiently sample lattice field theories.
method Combining neural-network layers with Monte Carlo updates.
result Stochastic normalizing flows are equivalent to out-of-equilibrium simulations.
Paper models Bitcoin market dynamics using 1+1D field theory.
problem Understanding stylized facts in Bitcoin markets.
method Collects order-book datasets, applies KPZ-like stochastic equations.
result Predicts order book dynamics with high precision.
Investigates spontaneous symmetry breaking in non-equilibrium systems.
problem Spontaneous symmetry breaking of ergodicity in non-equilibrium systems.
method Mathematical and effective field theory approaches to investigate symmetry breaking.
result Symmetry breaking phenomena observed in stochastic processes.
Analyzes high-dimensional SGD dynamics using DMFT.
problem Understanding the high-dimensional behavior of multi-pass SGD with small batch sizes.
method Derives DMFT equations for high-dimensional SGD dynamics.
result Proves DMFT equations characterize the asymptotic distribution of SGF parameters.
Study shows how market firm capitalization models converge to stochastic PDE solutions.
problem Understanding convergence of rank-based models with common noise to stochastic PDE solutions.
method Analysis of mean field limit, martingale problem, and pathwise entropy solutions.
result Empirical cumulative distribution function converges to solution of a stochastic PDE under certain conditions.
Proves equations for high-dimensional gradient-based methods from Gaussian data.
problem High-dimensional asymptotics of gradient-based learning algorithms.
method Closed-form equations derived from dynamical mean-field theory.
result Equations match those from discretized DMFT for gradient flow.
Develops asset pricing models with mean field game theory for heterogeneous agents.
problem Tackles equilibrium asset pricing in incomplete markets with heterogeneous agents.
method Uses mean field game theory and mean field backward stochastic differential equations (BSDEs).
result Derives equilibrium risk premium and shows market clearing in the large population limit.
STS clarifies chaos and stochastic dynamics, linking algebraic topology and physics.
problem Chaos and stochastic dynamics in arbitrary form SDEs.
method Supersymmetric theory of stochastic dynamics (STS) using generalized transfer operator (GTO) and topological field theories (TFT).
result Positive 'pressure' in GTOs corresponds to spontaneous breakdown of topological supersymmetry, explaining 1/f noise.
A stochastic theory for the toppling activity in sandpile models is developed, based on a simple mean-field assumption about the toppling process. The theory describes the process as an anti-persistent Gaussian walk, where the diffusion coefficient is proportional to the activity. It is formulated as a generalization o…
Study on price formation among investors with exponential utility and liabilities.
problem Equilibrium price formation among investors with heterogeneous risk-averseness and liabilities.
method Mean-field game theory and mean-field backward stochastic differential equations (BSDE).
result Existence of equilibrium risk-premium process and market clearing in the large population limit.
We analyze quantum Yang-Mills theory on R2 using a novel discretization method based on an algebraic analogue of stochastic calculus. Such an analogue involves working with "Gaussian" free fields whose covariance matrix is indefinite rather than positive definite. Specifically, we work with Lie-algebra valu…
This paper extends transfer operator theory to McKean-Vlasov equations.
problem Analyzing the behavior of complex dynamical systems using transfer operators.
method Extended dynamic mode decomposition and Galerkin projection.
result Finite-dimensional approximations of transfer operators computed.
The study analyzes stochastic Lie systems and their applications in various models.
problem Analyzing stochastic differential equations on manifolds.
method Coalgebra method for Hamiltonian stochastic Lie systems.
result New examples of stochastic Lie systems and Hamiltonian stochastic Lie systems are analyzed.
The paper models asset pricing in a partially observed market using mean field game theory and exponential quadratic Gaussian framework.
problem Asset pricing in a market with partial observation and heterogeneous agents.
method Mean field game theory, exponential quadratic Gaussian framework, Kalman-Bucy filtering theory.
result Characterization of equilibrium risk premium through mean field BSDE and construction of unobservable risk premium process.
New framework models neural systems with random architecture on manifolds.
problem Complex, uncertain systems with non-Gaussian outputs.
method Latent random field on compact manifold generates neural architecture and weights.
result Synthetic neural systems can produce stochastic outputs for deterministic inputs.
Study improves L∞ estimates and extreme value behavior in stochastic differential games.
problem Analyzing the mean-field limit of diffusive games through master equation.
method Using the Master Equation to approximate state processes and establishing L∞ estimates for the total error. result Established No∞ asymptotic behavior of upper order statistics of Nash states, initiating Extreme Value Theory for stochastic differential games. In this paper we introduce the stochastic Ricci flow (SRF) in two spatial dimensions. The flow is symmetric with respect to a measure induced by Liouville Conformal Field Theory. Using the theory of Dirichlet forms, we construct a weak solution to the associated equation of the area measure on a flat torus, in the full…
Gradient descent variants improve phase retrieval accuracy.
problem Phase retrieval problem in high-dimensional spaces.
method Gradient descent, stochastic gradient descent, Langevin algorithm, dynamical mean-field theory.
result Stochastic variants of gradient descent achieve better generalization in phase retrieval.
Game theory models how agents trade in a risky asset considering price impact and a common signal.
problem Modeling how financial agents liquidate assets in a risky market with price impact and a common signal.
method Formulated and solved a multi-player stochastic differential game and mean field game.
result Equilibrium strategies reveal how agents adjust the predictive trading signal to price impact.
Revises mean-field theory of Santa Fe model using kinetic theory.
problem Deriving a solid mathematical foundation for the Santa Fe model.
method Systematic derivation of BBGKY hierarchy from exact master equation.
result Explicit and closed-form solutions for mean-field equations.
Developed LQ MFG theory with common noise, proving existence and uniqueness.
problem Linear-quadratic mean field games with common noise.
method Coupled forward-backward stochastic evolution equations (FBSEEs) in Hilbert spaces.
result Existence and uniqueness of solutions for small and arbitrary finite time horizons.
New simulation method tackles sign problem in quantum fields.
problem Sign problem in real-time dynamics of quantum fields.
method Inspired by reinforcement learning, complex Langevin approach with learned optimal kernels.
result Significant extension of real-time simulations in 1+1d scalar field theory.
The paper uses machine learning to compute rare event probabilities in stochastic systems.
problem Characterizing rare events in stochastic dynamical systems with weak noise.
method Developed a neural network framework for computing quasipotential, most probable paths, and prefactors.
result Demonstrated higher effectiveness and accuracy of the algorithm in calculating mean exit times.
Stochastic Gradient Descent introduces noise in training, affecting model decision boundaries.
problem Understanding the impact of noise in SGD on model decision boundaries.
method Characterized SGD and persistent SGD dynamics in a neural network model, measuring noise magnitude in both under- and over-parametrized regimes.
result Noisier algorithms lead to wider decision boundaries in constraint satisfaction problems.
In this paper we present a framework to analyze the asymptotic behavior of two timescale stochastic approximation algorithms including those with set-valued mean fields. This paper builds on the works of Borkar and Perkins & Leslie. The framework presented herein is more general as compared to the synchronous two times…
Study on LOB dynamics using mean-field game theory.
problem Modeling liquidity dynamics in limit order books.
method Mean-field stochastic differential equation and control problem formulation.
result Equilibrium density function of LOB can be derived.
New optimization algorithms on orthogonal group for machine learning.
problem Efficient optimization on the orthogonal group for machine learning tasks.
method Stochastic geometric algorithms on Lie groups.
result Strong performance on diverse machine learning tasks.
Abstract: Surveying connections between ML and Control Theory.
problem Addressing the intersection of Machine Learning and Control Theory.
method Develops connections through reinforcement learning, supervised learning, deep learning, and stochastic gradient descent.
result Machine Learning and Control Theory are interconnected, with ML solving large control problems and Control Theory providing tools for ML.
Boltzmann machines are undirected graphical models with two-state stochastic variables, in which the logarithms of the clique potentials are quadratic functions of the node states. They have been widely studied in the neural computing literature, although their practical applicability has been limited by the difficulty…
Efficiently quantifies uncertainty in subsurface flow using neural networks guided by theory.
problem Uncertainty in dynamic subsurface flow predictions.
method Theory-guided Neural Network (TgNN) for efficient uncertainty quantification.
result TgNN surrogate improves efficiency of uncertainty quantification compared to MC method.
Analyzes feature learning in neural networks using a self-consistent dynamical field theory.
problem Feature learning in infinite-width neural networks.
method Constructs deterministic dynamical order parameters as inner-product kernels for hidden unit activations and gradients.
result Reveals the hidden layer activation distribution, neural tangent kernel evolution, and output predictions.
Exact solution found for two-body financial dealer model using kinetic theory.
problem Finding an exact solution for the two-body financial dealer model.
method Exact master-Liouville equations derived using kinetic theory and probability currents.
result Exact order-book profile and average transaction interval derived.
Method identifies IPS governing equations from particle data efficiently.
problem Identify governing equations of interacting particle systems efficiently.
method Combines mean-field theory and WSINDy for large N and M. result Converges with rate O(N−1/2) for N≥100. Proposes a stochastic method for solving trilevel optimization problems.
problem Efficient and theoretically sound methods for trilevel optimization.
method Stochastic gradient descent method for unconstrained trilevel optimization.
result First convergence theory for stochastic methods in trilevel optimization.
New model improves field learning with improved equivariance.
problem Learning equivariant stochastic fields.
method Equivariant Gaussian processes and Steerable Conditional Neural Processes.
result SteerCNPs significantly improve performance in transfer learning tasks.
Modeling price formation in intraday electricity markets with renewable generation.
problem Price formation and optimal trading strategies in intraday electricity markets with intermittent renewable generation.
method Developed a tractable equilibrium model using stochastic control theory to identify optimal strategies and exhibit Nash equilibrium.
result Identified optimal trading strategies and exhibited Nash equilibrium in closed form for a finite number of agents and in the asymptotic framework of mean field games.
A new paradigm recently emerged in financial modelling: rough (stochastic) volatility, first observed by Gatheral et al. in high-frequency data, subsequently derived within market microstructure models, also turned out to capture parsimoniously key stylized facts of the entire implied volatility surface, including extr…
Study of LQ MFGs in infinite-dimensional Hilbert spaces.
problem Mean field games in infinite-dimensional settings with stochastic dynamics.
method Analysis of coupled semilinear infinite-dimensional stochastic evolution equations, development of Nash equilibrium.
result Characterization of unique Nash equilibrium in the limit of many agents.
Optimal trading strategies identified in electricity markets with a major player.
problem Price formation and optimal trading in intraday electricity markets with strategic interactions.
method Stochastic control theory and mean field games with a major player.
result Nash equilibrium identified in closed form for the asymptotic case.
Develops a mean-field theory for multi-head self-attention under cross-entropy training.
problem Mean-field analysis of multi-head self-attention under cross-entropy training.
method Mean-field theory for a simplified single-layer causal multi-head self-attention model.
result Proves a static finite-head approximation bound for the optimal risk.
The work proposes a geometric background of the theory of field interactions and strings in spaces with higher order anisotropy. Our approach proceeds by developing the concept of higher order anisotropic superspace which unifies the logical and mathematical aspects of modern Kaluza-Klein theories and generalized Lagra…
Novel approach to Nash equilibrium in mean-field stochastic games with operator resolvents.
problem Finding Nash equilibrium in mean-field stochastic games with mean-field interaction.
method Proposed a novel approach to derive Nash equilibrium semi-explicitly using operator resolvents and stochastic Fredholm equations.
result Equilibrium of the N-player game converges to mean-field equilibrium, and ε-Nash equilibrium derived as a by-product. Introduces a neural network-based method for efficient state and parameter estimation in complex systems.
problem Efficiently estimating state paths and parameters from noisy measurements in high-dimensional nonlinear systems.
method Bayesian Information Field Theory with neural network parameterization and optimization algorithms.
result Proposes a method to simplify and enrich state path parameterizations using neural networks, improving inference accuracy.
This paper organizes recent deep learning theory advances.
problem Lack of theoretical foundations in deep learning.
method Literature review and categorization into six groups.
result Organized recent advances in deep learning theory.
Model asset pricing with habit formation in a large market.
problem Understanding asset pricing in large heterogeneous markets with habit formation.
method Mean field game theory and quadratic-growth mean field BSDEs.
result Derives a semi-analytic solution for asset pricing model.