Uniform bounds for neural network convergence without strong convexity assumptions.
problem Understanding the convergence of neural networks in the feature-learning regime.
method Establishing uniform-in-time weak propagation-of-chaos via mean-field deterministic Wasserstein-gradient-flow dynamics.
result Uniform bounds on the difference between infinite-width and finite-width neural network outputs, showing that fewer neurons can achieve a desired loss.
Uniform-in-time analysis for Stein Variational Gradient Descent across various metrics.
problem Understanding long-term behavior of finite-particle systems in relation to their mean-field limits.
method Developed uniform-in-time propagation-of-chaos results for continuous-time SVGD using cutoff strategies and finite-dimensional theories.
result Uniform-in-time propagation-of-chaos bounds in various metrics, including Langevin kernel Stein discrepancy, Wasserstein-1, and Wasserstein-2 distances.
Improved sampling from complex distributions with reduced bias.
problem Reducing bias in high-dimensional sampling algorithms.
method Hierarchical entropy analysis to weaken assumptions and expand scope.
result Bias reduction in low-dimensional marginals scales with lower dimension, not full dimension.
A new stochastic algorithm approximates optimal distributions without requiring propagation of chaos.
problem Optimizing functionals over probability distributions using finite particle systems.
method Virtual particle stochastic approximation, viewed as a form of stochastic gradient descent in the Wasserstein space.
result The algorithm's output converges to the optimal distribution and produces i.i.d. samples.
Existence of calibrated local stochastic volatility models proven for non-regular coefficients.
problem Existence of calibrated local stochastic volatility models in finance.
method Investigation of McKean--Vlasov equations with minimal continuity assumptions on coefficients, providing existence and propagation of chaos results.
result Existence of calibrated local stochastic volatility models for appropriate stochastic volatility parameters.
Study shows uniform-time chaos propagation in mean field Langevin dynamics.
problem Understanding the convergence of marginal distributions in mean field dynamics.
method Assumed functional convexity of energy, used Lp-convergence and Wasserstein metrics. result Uniform-in-time propagation of chaos proved in both L2-Wasserstein and relative entropy. Improved PoC for MFLD reduces approximation error and provides model ensemble guarantees.
problem Quantifying optimization complexity in mean-field Langevin dynamics.
method Refined defective log-Sobolev inequality for neural network training.
result Improved PoC result with reduced approximation error and theoretical model ensemble guarantees.
This work develops a particle system to approximate Fisher-Rao gradient flows in mean-field optimization.
problem Optimizing probability measures in neural network contexts.
method Constructing an interacting particle system approximating Fisher-Rao gradient flows.
result Propagation of chaos for the Fisher-Rao gradient flow in entropic mean-field optimization.
Study shows how SGD in large neural networks behaves as neurons increase.
problem Understanding SGD behavior in overparameterized neural networks.
method Probabilistic approach to continuous-time dynamics of SGD, focusing on particle interactions.
result Particles' interactions asymptotically vanish, leading to a mean-field limit.
The paper studies Hawkes processes under mean-field limits and criticality conditions.
problem Analyzing nearly unstable Hawkes processes in a mean-field regime.
method Extending the method by Jaisson and Rosenbaum, establishing scaling limits and propagation of chaos.
result Scaling limits of Hawkes processes are stochastic Volterra diffusions of affine type, with three distinct limiting regimes.
Proves existence and uniqueness of calibrated LSV model.
problem Calibrating a local stochastic volatility model to market data.
method Proves strong existence and uniqueness of solution to a McKean-Vlasov SDE.
result Establishes well-posedness of a calibrated two-factor LSV model.
New algorithm for solving minimax problems over distributions converges to Nash equilibrium.
problem Solving minimax problems over probability distributions.
method Symmetric Mean-field Langevin Dynamics (MFL-AG and MFL-ABR) with weighted averaging and best response dynamics.
result Converges to mixed Nash equilibrium with average-iterate and last-iterate convergence.
Develops a framework for analyzing neural networks and ODE models using control theory.
problem Analyzing deep neural networks and neural ODE models trained with stochastic gradient algorithms.
method Identifies connections between control theory, deep learning, and statistical sampling; derives Pontryagin's optimality principle and Mean-Field Langevin dynamics.
result Derives explicit convergence rates and provides quantitive bounds on generalization error, showing dimension-independent rates.
Novel RKHS approach solves complex financial model equations.
problem Calibrating singular local stochastic volatility models.
method Reproducing Kernel Hilbert Space (RKHS) regularization.
result Regularized model is well-posed and replicates option prices.
Motivated by a probabilistic approach to Kahler-Einstein metrics we consider a general non-equilibrium statistical mechanics model in Euclidean space consisting of the stochastic gradient flow of a given (possibly singular) quasi-convex N-particle interaction energy. We show that a deterministic "macroscopic" evolution…
Improved particle approximation for mean-field neural networks.
problem Particle approximation error for mean-field neural networks.
method Improved particle approximation error by leveraging the problem structure in risk minimization.
result Established an LSI-constant-free particle approximation error concerning the objective gap.
The paper analyzes arbitrage opportunities in a large investor market with common stock noises.
problem Identifying arbitrage opportunities in a market with many competitive investors.
method Stochastic differential games and mean-field systems to study market dynamics and optimal arbitrage.
result Optimal arbitrage is characterized by a solution to a Cauchy PDE involving volatility terms.
Nonlinear MCMC improves Bayesian machine learning sampling.
problem Sampling problems in Bayesian machine learning.
method Nonlinear MCMC technique with convergence guarantees.
result Improves sampling in Bayesian neural networks.
Improved convergence rates for MFLD in various gradient estimators.
problem Proving convergence rates for mean-field Langevin dynamics with stochastic gradient updates.
method General framework for propagation of chaos, including finite-particle approximation, time-discretization, and stochastic gradient approximation.
result Improved convergence rates for SGD and SVRG settings.
Study simulates Heston-type local stochastic volatility model using particle method.
problem Simulate calibrated Heston-type local stochastic volatility model with non-standard coefficients.
method Monte Carlo particle method, Euler-Maruyama scheme, full truncation Euler scheme.
result Strong convergence of Euler-Maruyama scheme with rate 1/2 in time, up to a logarithmic factor.
New SGD variant makes neural networks compressible without assumptions.
problem Improving neural network compressibility without strong assumptions.
method Introducing heavy-tailed noise to SGD iterates.
result Compressible outputs with high probability for any compression rate.
We contribute to the understanding of how systemic risk arises in a network of credit-interlinked agents. Motivated by empirical studies we formulate a network model which, despite its simplicity, depicts the nature of interbank markets better than a homogeneous model. The components of a vector Ornstein-Uhlenbeck proc…
Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemen…
We consider systems of diffusion processes ("particles") interacting through their ranks (also referred to as "rank-based models" in the mathematical finance literature). We show that, as the number of particles becomes large, the process of fluctuations of the empirical cumulative distribution functions converges to t…
ResNets converge to a limit model with improved error rates.
problem Understanding convergence of ResNets in the large-scale limit.
method Combining cavity method and propagation of chaos arguments on skeleton maps.
result Convergence rate of O(1/sqrt(D)) for ResNets in the large-scale limit.
Study controlled contagion with state-dependent killing, proving a comparison principle.
problem Analyzing controlled McKean--Vlasov contagion with state-dependent killing.
method Proof of a comparison principle using Wasserstein smooth-gauge comparison and killing-jump absorption estimates.
result Established a comparison principle for the two-population killed-particle HJB.
The paper studies how noise synchronizes tokens in deep transformer models.
problem Understanding synchronization in deep learning models with noise.
method Proves convergence to a stochastic particle system and identifies the limiting SDE.
result The limiting model displays synchronization by noise and exponential dissipation of interaction energy.
Extends Langevin dynamics for constrained domains.
problem Optimization of constrained probability measures.
method Mirror mean-field Langevin dynamics (MMFLD).
result Linear convergence guarantees and propagation of chaos results.
Improved sampling from mean-field stationary distributions.
problem Sampling from the stationary distribution of mean-field SDEs.
method Decoupling the problem into two aspects: approximation of mean-field SDE and sampling from finite-particle distribution.
result Improved guarantees in various settings, including optimizing neural networks.
We discuss general notions of metrics and of Finsler structures which we call weak metrics and weak Finsler structures. Any convex domain carries a canonical weak Finsler structure, which we call its tautological weak Finsler structure. We compute distances in the tautological weak Finsler structure of a domain and we …
New structures defined for studying contact foliations and their geometry.
problem Understanding dynamics of contact foliations and their applications.
method Define and study weak nearly S- and weak nearly C-structures.
result Characterize weak nearly S- and weak nearly C- submanifolds in weak nearly Kähler manifolds.
Tensoring p-weak differentiable structures preserves their properties.
problem Tensorization of p-weak differentiable structures. method Proving the product of p-weak charts is a p-weak chart, and showing isometric embeddings. result Tensorization of p-weak differentiable structures is possible under certain conditions. The study examines conditions for weak nearly cosymplectic manifolds to split into products.
problem Understanding the curvature and topology of weak nearly cosymplectic manifolds.
method Analyzes the conditions for splitting and characterizes specific manifolds.
result Conditions for weak nearly cosymplectic manifolds to become Riemannian products are identified.
Subset selection improves weak supervision performance.
problem Optimizing the use of weakly-labeled data.
method Combining pretrained data representations with the cut statistic for subset selection.
result Subset selection improves weak supervision performance by up to 19%.
Defines weak geodesics on specific subsets of manifolds.
problem Characterizing geodesics on prox-regular subsets of Riemannian manifolds.
method Defining weak geodesics as continuous curves with weak regularities, and characterizing them as viscosity critical points of the energy functional.
result Characterizes weak geodesics on prox-regular subsets of Riemannian manifolds.
Study weak conjugacy in surface homeomorphisms.
problem Understanding weak conjugacy in homeomorphisms of surfaces.
method Exploring the group of homeomorphisms isotopic to the identity.
result New insights into weak conjugacy relations.
New model shows weak teachers can help strong students learn even with imperfect labels.
problem Improving strong student's performance with weak teacher's imperfect pseudolabels.
method Stylized overparameterized spiked covariance model with Gaussian covariates, proving two phases of generalization.
result Provable successful and random guessing phases of strong student's generalization.
Introduces weak (p,k)-Dirac structures in geometric settings.
problem Defining and analyzing new geometric structures.
method Introducing and studying weak (p,k)-Dirac structures in TM⊕ΛpT∗M. result Weak (p,k)-Dirac structures contain more information than (p,k)-Lagrangian structures. RAVEN improves weak-to-strong generalization under distribution shifts.
problem Weak models fail to supervise strong models effectively under distribution shifts.
method RAVEN dynamically learns optimal combinations of weak models and strong model parameters.
result RAVEN outperforms existing methods by over 30% on out-of-distribution tasks.
Study weak f-K-contact manifolds, finding Einstein-type metrics and solitons.
problem Characterize and study geometric properties of weak f-K-contact manifolds. method Analyzing weak metric f-structures, using Killing vector fields, and Jacobi operators. result Einstein weak f-K-contact manifolds are Ricci flat. Study the geometry of weak para-f-structures and subclasses.
problem Understand the geometry of weak para-f-structures and their subclasses.
method Express covariant derivative of f, prove Killing characteristic vector fields, show foliations, and demonstrate rigidity.
result Prove that characteristic vector fields are Killing and ker f defines a totally geodesic foliation.
Weak labels can significantly speed up learning for strong tasks.
problem Learning with limited strong labels.
method Using weak labels to accelerate learning of strong tasks.
result Weak labels can accelerate learning to O(icefrac1n) rate. The study explores new metric structures on manifolds, linking them to Einstein metrics.
problem Characterizing and understanding weak K-contact manifolds and their properties.
method Analyzing weak K-contact manifolds and their properties, including the parallel Ricci tensor and generalized Ricci soliton structures.
result Sufficient conditions for weak K-contact manifolds with specific properties to be Einstein manifolds.
Study on Ricci solitons and Einstein metrics in weak β-Kenmotsu manifolds.
problem Characterizing Einstein metrics in weak β-Kenmotsu manifolds.
method Adapted ∗-Ricci tensor to weak almost contact manifolds and studied its interaction with weak β-Kenmotsu structures. result New characteristics of Einstein metrics obtained.
This paper studies properties of weak reducing pairs in critical Heegaard splittings.
problem Characterize weak reducing pairs in critical Heegaard splittings.
method Analyze the properties of weak reducing pairs in critical Heegaard splittings.
result Provide a necessary condition for a Heegaard surface to be critical.
We study weakened f-structures on manifolds, generalizing classical results.
problem Classical f-structures and their properties on manifolds. method Introduced and studied weakened f-structures, subclasses, and their properties. result Generalized known results on globally framed f-manifolds. Equivalent bicategories constructed from action Lie groupoids.
problem Equivalence of bicategories constructed from action Lie groupoids.
method Localizing at equivariant weak equivalences, surjective submersive equivariant weak equivalences, and all weak equivalences.
result Weak equivalences between action Lie groupoids are isomorphic to compositions of nice forms of equivariant weak equivalences.
We deal with a notion of weak binormal and weak principal normal for non-smooth curves of the Euclidean space with finite total curvature and total absolute torsion. By means of piecewise linear methods, we first introduce the analogous notation for polygonal curves, where the polarity property is exploited, and then m…