Federated learning linked to mean-field games for large-scale learning.
problem Large-scale distributed and privacy-preserving learning algorithms.
method Established a connection between federated learning and mean-field games, presenting federated learning as a differential game.
result Properties of the equilibrium of the federated learning game were discussed.
Transformers approximate mean-field dynamics of indistinguishable particles.
problem Approximating the dynamics of indistinguishable particles in complex systems.
method Using transformers to model the mean-field dynamics of interacting particle systems.
result Theoretical bounds on the distance between true and transformer-obtained mean-field dynamics.
Nonnegative Boltzmann machines (NNBMs) are recurrent probabilistic neural network models that can describe multi-modal nonnegative data. NNBMs form rectified Gaussian distributions that appear in biological neural network models, positive matrix factorization, nonnegative matrix factorization, and so on. In this paper,…
New algorithm solves mean-field control problems using actor-critic learning with moment neural networks.
problem Solving mean-field control problems in continuous time reinforcement learning.
method Gradient-based policy and value function learning with moment neural networks on the Wasserstein space.
result Effective solution for diverse mean-field control problems, including multi-dimensional and nonlinear settings.
The paper connects PSO and CBO methods using stochastic modeling and mean-field limits.
problem Global optimization problems with particle swarm optimization and consensus based optimization.
method Stochastic differential equations and mean-field approximation to derive macroscopic hydrodynamic equations.
result Derives mean-field approximation for PSO and links it to CBO methods.
We study discrete-time mean-field Markov games with infinite numbers of agents where each agent aims to minimize its ergodic cost. We consider the setting where the agents have identical linear state transitions and quadratic cost functions, while the aggregated effect of the agents is captured by the population mean o…
New methods learn correlated equilibria in large games without structural assumptions.
problem Learning correlated equilibria in large, anonymous games with exponential player count.
method Developed Mean-Field correlated and coarse-correlated equilibria, and used classical algorithms to learn them efficiently.
result Efficiently learned correlated equilibria in all games without structural assumptions.
Unified analysis of DLNs using DMFT reveals dynamics of loss convergence and generalization trade-offs.
problem Understanding the overall dynamics of diagonal linear networks (DLNs) in neural network training.
method Dynamical Mean-Field Theory (DMFT) applied to DLNs.
result Derives low-dimensional effective process capturing high-dimensional gradient flow dynamics.
RL in MFGs is as hard as solving many single-agent RL problems.
problem Learning Nash Equilibrium in Mean-Field Games (MFGs).
method Introduce P-MBED to measure model complexity, develop a novel exploration strategy, and establish polynomial sample complexity results.
result Learning Nash Equilibrium in MFGs is no more statistically challenging than solving a logarithmic number of single-agent RL problems.
New algorithm reduces MFGs with common noise complexity.
problem Prohibitive computational cost in solving MFGs with common noise.
method Signatured deep fictitious play based on rough path theory.
result Significantly reduced computational complexity and improved efficiency.
Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can be observed that is poorly understood. In this work, we show how mean field inference improves generalization by limiting mutual information …
Model explains capital allocation and wealth distribution dynamics in a frictional economy.
problem Understanding capital allocation and wealth distribution dynamics in a frictional economy.
method Mean-field game approach to model interactions between expert and household groups.
result Experts accumulate capital during booms and quickly reverse behavior in busts, even without macro-shocks.
Model analyzes competitive pricing strategies in large markets of perishable products.
problem Maximizing profits in a competitive market of perishable products.
method Mean-field competition model, Hamilton-Jacobi-Bellman equation, iterative numerical algorithm.
result Properties of equilibrium pricing strategies and market dynamics.
Study analyzes adversarial training dynamics without data distribution assumptions.
problem Understanding training dynamics of adversarial training without data distribution assumptions.
method Mean field theory approach to analyze adversarial training in random deep neural networks.
result Upper bounds of adversarial loss derived empirically and theoretically.
Study uses neural nets to learn multi-index models in high dimensions, reducing complexity.
problem Learning multi-index models in high-dimensional data.
method Mean-field Langevin dynamics with neural networks.
result Effective dimension controls sample and computational complexity, potentially reducing it.
Study approximates operators on labelled conditional distributions for non-exchangeable systems.
problem Approximating operators on constrained probability measures for non-exchangeable systems.
method Combines cylindrical approximations and DeepONet-type neural architecture for finite-dimensional representations.
result Establishes a universal approximation theorem for continuous operators on Mλ. This paper studies how relative performance concerns affect stock prices in a tree-like market model.
problem The impact of relative performance concerns on stock prices in a tree-like market model.
method Mean-field equilibrium analysis in a binomial tree framework with exponential utility.
result Existence and uniqueness of market-clearing mean-field equilibrium in both single- and multi-population settings.
Paper adds Fisher Information to mean field optimization for faster convergence.
problem Mean field optimization in neural networks training.
method Developed energy-dissipation method and gradient flow on probability space.
result Marginal distributions converge exponentially to minimizer.
Centralized exchanges influence staking behavior and decentralization in Proof of Stake blockchain ecosystems.
problem How do centralized exchanges affect staking behavior and decentralization in Proof of Stake blockchain ecosystems?
method Formulate a continuous-time mean field model of miners as validators and traders in a centralized market.
result Centralized trading activities enhance staking participation and promote decentralization through market incentives.
Study explores optimal strategies in games with multiple players and mean-field interactions.
problem Optimal strategies in games with multiple players and mean-field interactions.
method Exploration of three different notions of optimality, including mean-field control solution, mean-field coarse correlated equilibria, and mean-field Nash equilibria.
result Approximation of cooperative and competitive equilibria in large N-player games by mean-field control and mean-field equilibria. Modeling price formation with interacting Hawkes processes leading to stochastic volatility with leverage.
problem Capturing the complex dynamics of price formation in financial markets.
method Agent-based approach to aggregate self-exciting point processes with mean-field interaction.
result Aggregated model converges to a stochastic volatility model with leverage effect and faster-than-linear mean reversion.
Study on neural networks' performance under different normalizations as N grows.
problem Characterizing neural networks' performance under various normalizations.
method Developed an asymptotic expansion to analyze statistical output of shallow neural networks.
result No bias-variance trade-off exists to leading order in N, and variance decreases as normalization approaches mean field.
New algorithm controls large groups of devices to match energy demand signals.
problem Controlling large populations of electrical devices to match energy demand signals.
method Developed MD-MFC algorithm for finite horizon Markovian mean field control problem.
result MD-MFC provides theoretical guarantees for convex and Lipschitz objective functions.
New method improves approximate inference for Bayesian models.
problem Approximate inference for high-dimensional Bayesian models.
method Entropic regularization of mean-field variational inference.
result Improved recovery of true posterior dependency.
Proves equations for high-dimensional gradient-based methods from Gaussian data.
problem High-dimensional asymptotics of gradient-based learning algorithms.
method Closed-form equations derived from dynamical mean-field theory.
result Equations match those from discretized DMFT for gradient flow.
Unified q-learning for mean-field jump-diffusion models with unobservable population distribution.
problem Continuous-time q-learning in mean-field jump-diffusion models with unobservable population distribution.
method Proposed decoupled Iq-function for unified policy evaluation in MFG and MFC problems; unified q-learning algorithm based on test policies and averaged martingale orthogonality condition.
result Unified policy evaluation rule for MFG and MFC problems based on decoupled Iq-function.
We propose a mean field game model to study the question of how centralization of reward and computational power occur in Bitcoin-like cryptocurrencies. Miners compete against each other for mining rewards by increasing their computational power. This leads to a novel mean field game of jump intensity control, which we…
Existence of strong randomized equilibria in mean-field games with common noise.
problem Existence of strong solutions in mean-field games of optimal stopping.
method Connection with Bank-El Karoui's representation problem and continuity assumptions.
result Existence of strong randomized mean-field equilibrium under certain conditions.
Develops a control framework for systemic risk under uncertainty.
problem Systemic risk under model uncertainty.
method Linear-quadratic mean-field control framework with viscosity solutions and verification theorems.
result Explicit feedback controls derived from a coupled Riccati system, preserving analytical tractability.
New RL algorithms achieve optimal policies with polynomial sample complexity for mean-field problems.
problem Statistical efficiency of Mean-Field Reinforcement Learning with general function approximation.
method Introduce MF-MBED to characterize problem complexity, propose algorithms based on maximal likelihood estimation.
result Rich mean-field RL problems have low MF-MBED, leading to polynomial sample complexity.
Elman-type RNNs converge to globally optimal solutions in the mean-field regime.
problem Optimizing feature learning in wide RNNs.
method Analysis of gradient descent dynamics and mean-field limits.
result Fixed points of infinite-width dynamics are globally optimal.
Study on mean field games with singular controls and their applications.
problem Optimal productivity expansion in dynamic oligopolies.
method Existence and uniqueness of mean field equilibria through nonlinear equations, Abelian limit for discounted and ergodic games.
result Valid connection between discounted and ergodic games, approximation of Nash equilibria.
Boltzmann machines are undirected graphical models with two-state stochastic variables, in which the logarithms of the clique potentials are quadratic functions of the node states. They have been widely studied in the neural computing literature, although their practical applicability has been limited by the difficulty…
Study on stock price formation on trees with multi-population and non-rational agents.
problem Equilibrium price formation for risky stock with multi-population and non-rational agents.
method Combining mean-field game theory with binomial tree framework, proving existence of unique equilibrium, deriving explicit formula for transition probabilities.
result Existence of unique mean-field market-clearing equilibrium with explicit analytic formula for stock price transition probabilities.
Finding an energy minimum in the Ising model is an exemplar objective, associated with many combinatorial optimization problems, that is computationally hard in general, but occurs in all areas of modern science. There are several numerical methods, providing solution for the medium size Ising spin systems. However, th…
Safe-M3-UCRL learns safe policies for multi-agent systems with global constraints.
problem Global constraints in mean-field reinforcement learning for multi-agent systems.
method Safe-M3-UCRL uses epistemic uncertainty and log-barrier approach to ensure constraints satisfaction. result Safe-M3-UCRL learns safe policies for multi-agent systems with global constraints. Study shows uniform-time chaos propagation in mean field Langevin dynamics.
problem Understanding the convergence of marginal distributions in mean field dynamics.
method Assumed functional convexity of energy, used Lp-convergence and Wasserstein metrics. result Uniform-in-time propagation of chaos proved in both L2-Wasserstein and relative entropy. The mean field algorithm is a widely used approximate inference algorithm for graphical models whose exact inference is intractable. In each iteration of mean field, the approximate marginals for each variable are updated by getting information from the neighbors. This process can be equivalently converted into a feedf…
Global convergence of multilayer neural networks proven for any depth.
problem Global convergence of multilayer neural networks in the mean field regime.
method Mean field limit framework, neuronal embedding, bidirectional diversity condition.
result Global convergence for multilayer networks of any depths, including correlated initializations.
We derive streamlined mean field variational Bayes algorithms for fitting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, streamlining is hindered by lack of sparseness in the underlying least squares system. Because of th…
New SDEs use G-Brownian motion, extending mean-field models.
problem Extending mean-field models to new types of stochastic processes.
method Introduced G-SDEs with coefficients dependent on current state and solution as random variable. result Validated new SDE framework for complex stochastic systems.
The mean field methods, which entail approximating intractable probability distributions variationally with distributions from a tractable family, enjoy high efficiency, guaranteed convergence, and provide lower bounds on the true likelihood. But due to requirement for model-specific derivation of the optimization equa…
The study analyzes deep linear networks from random initialization, capturing dynamics and hyperparameter effects.
problem Understanding training dynamics in deep linear networks from random initialization.
method Theoretical analysis of gradient descent dynamics in deep linear networks with random initialization and large data.
result Captures the 'wider is better' effect and hyperparameter transfer effects, contrasting with neural-tangent parameterization.
New algorithm improves CRF inference and learning.
problem Efficient inference and learning for dense CRFs.
method Regularized Frank-Wolfe algorithm for nonconvex CRF optimization.
result Regularized Frank-Wolfe outperforms mean field and CNN baselines.
We introduce and analyze a linear kinetic model that describes the evolution of the probability density of the number of firms in a society, in which the microscopic rate of change obeys to the so-called law of proportional effect proposed by Gibrat. Despite its apparent simplicity, the possible mean field limits of th…
New neural networks learn mappings between probability measures and functions.
problem Learning mappings between Wasserstein space of probability measures and function spaces.
method Two types of neural networks: bin density and cylindrical approximation, are proposed and supported by universal approximation theorems.
result Accuracy and efficiency of mean-field neural networks in generalization error with various test distributions.
This work learns models for population dynamics using variational methods and higher-order quadrature.
problem Modeling population dynamics of physical systems with stochastic and mean-field effects.
method Variational problem to infer gradient fields, combining Monte Carlo sampling with higher-order quadrature rules.
result Accurate prediction of population dynamics over a wide range of parameters.
Study equilibrium consumption habits in a large population using mean field games.
problem Equilibrium consumption under external habit formation in a large population.
method Formulated and solved mean field games for linear and multiplicative habit formation preferences, constructed approximate Nash equilibria for large n-player games.
result Characterized mean field equilibrium strategies and derived financial implications.