This work finds mixed equilibria in zero-sum games using interacting particle dynamics.
problem Finding mixed equilibrium points in continuous minmax games.
method A method based on entropic regularisation of two-layer zero-sum games with interacting particle dynamics.
result The sequence of empirical measures of the particle system satisfies a large deviation principle as the number of particles grows to infinity, implying convergence of the empirical measure and the Nikaidô-Isoda error.
GER learns particle dynamics from unpaired snapshots using physics-informed GANs.
problem Learning particle dynamics from unpaired snapshots with physics constraints.
method Physics-informed generative model to fit particle ensemble distributions.
result Inferred dynamics of particle ensembles governed by SODEs up to 100 dimensions.
The paper proposes a GP-based method for discovering second-order particle dynamics models.
problem Discovering a general second-order particle-based model for agent interactions.
method Gaussian Process-based approach integrating two independent GP priors on latent interaction kernels.
result The method learns effective nonlinear dynamics representations from small data sets.
Study infers interaction kernels from multiple particle trajectories.
problem Inferring interaction kernels from multiple particle trajectories in stochastic systems.
method Nonparametric inference approach based on regularized maximum likelihood estimator.
result Consistent estimator with near-optimal learning rate independent of state space dimension.
Inferring the laws of interaction between particles and agents in complex dynamical systems from observational data is a fundamental challenge in a wide variety of disciplines. We propose a non-parametric statistical learning approach to estimate the governing laws of distance-based interactions, with no reference or a…
Gaussian process framework learns interaction kernels in multi-species particle systems.
problem Learning interaction kernels in multi-species interacting particle systems from trajectory data.
method Nonparametric Bayesian approach with Gaussian processes.
result Established rigorous statistical guarantees for recoverability and optimality of interaction kernels.
Model financial default cascades on sparse graphs via hitting times.
problem Capturing systemic risk in large, sparsely-connected financial networks.
method Dynamic particle systems with hitting times and convergence theory.
result Characterization of default time distribution in tree-like networks.
SPH-ParVI uses fluid dynamics to sample unknown densities efficiently.
problem Sampling partially known densities or using gradients in probabilistic models.
method Smoothed Particle Hydrodynamics (SPH) for modeling fluid dynamics to approximate target densities.
result SPH-ParVI provides fast, flexible, scalable, and deterministic sampling for Bayesian inference and generative models.
Algorithm learns interaction kernels for particle systems from data.
problem Understanding and modeling interactions in systems of interacting particles.
method Nonparametric algorithm using least squares with regularization, probabilistic error functional, and reproducing kernel Hilbert space convergence.
result The algorithm converges optimally and accurately learns interaction kernels.
Flocking refers to collective behavior of a large number of interacting entities, where the interactions between discrete individuals produce collective motion on the large scale. We employ an agent-based model to describe the microscopic dynamics of each individual in a flock, and use a fractional PDE to model the evo…
We characterize the collective phenomena of a liquid market. By interpreting the behavior of a no-arbitrage N asset market in terms of a particle system scenario, (thermo)dynamical-like properties can be extracted from the asset kinetics. In this scheme the mechanisms of the particle interaction can be widely investiga…
Study generalizes non-interaction theorems for relativistic systems.
problem Understanding interactions in relativistic and non-relativistic systems.
method Generalizes non-interaction theorems for Lorentz violating systems and Galilei invariant systems.
result Extends analysis to very special relativity and anisotropic systems.
New approach reduces particle simulation complexity to linear time and space.
problem Challenges in learning dynamics from particle interactions, especially N-body problems.
method Transforms fully-connected interaction graphs into hierarchical ones, reducing complexity.
result Linear time and space complexity for large-scale simulations, retaining high accuracy.
New method optimizes multiple objectives using particle dynamics and gradient flow.
problem Optimizing multiple conflicting objectives in complex scenarios.
method Interacting particle method combining Langevin and birth-death dynamics with a dominance potential.
result Method effectively relocates dominated particles, improving Pareto optimality.
New method learns latent energy models using particle algorithms.
problem Learning latent variable models with energy priors.
method Continuous-time SDEs for MMLE, particle-based discretization.
result Practical algorithm converges to solve MMLE problem.
Randomized feature models learn interaction kernels from agent paths.
problem Learning interaction kernels from noisy agent paths.
method Randomized feature algorithm and sparse regression.
result Pruned features reduce overfitting and lower simulation cost.
Improved particle approximation for mean-field neural networks.
problem Particle approximation error for mean-field neural networks.
method Improved particle approximation error by leveraging the problem structure in risk minimization.
result Established an LSI-constant-free particle approximation error concerning the objective gap.
MPM-ParVI uses particle sampling for variational inference.
problem Variational inference for complex probabilistic models.
method Material Point Method (MPM) for particle-based simulation.
result Deterministic sampling and inference for intractable densities.
Study on convergence of Langevin dynamics for zero-sum games in probability distributions.
problem Analyzing convergence of Langevin dynamics for zero-sum games in probability distributions.
method Proved exponential and biased convergence guarantees for mean-field and finite-particle min-max Langevin dynamics.
result Explicit iteration complexity for finite-particle algorithms to approximate equilibrium distributions.
New method accelerates energetic variational inference using particle dynamics.
problem Efficiently solving variational inference problems with reduced computational cost.
method Particle-based variational inference with implicit scheme, inspired by energy quadratization and operator splitting.
result Significantly reduces computational cost compared to existing methods.
Framework for joint inference of network topology and interaction types in heterogeneous systems.
problem Joint inference of network topology, multi-type interaction kernels, and latent type assignments in heterogeneous interacting particle systems.
method Three-stage approach: shared structure recovery, discrete interaction type identification, and matrix factorization.
result The method yields accurate reconstruction of underlying dynamics and is robust to noise.
New methods for Bayesian inference using mean shift particle systems.
problem Approximating expectations with unnormalized densities in Bayesian inference.
method Mean shift interacting particle systems that minimize maximum mean discrepancy (MMD).
result Mean shift interacting particle systems converge quickly and capture complex distributions.
Estimates log-likelihood of interacting particle systems using virtual particles.
problem Inconsistent estimation of finite-particle log-likelihood in large particle systems.
method Stochastic gradient estimate using continuous trajectory and virtual particle systems.
result Convergence to stationary points of limiting mean-field system's log-likelihood.
Estimates network structure and interaction rules from multiple agent trajectories.
problem Modeling multi-agent systems on networks from data.
method Jointly infers network topology and interaction kernels using non-convex optimization.
result ORALS estimator is consistent and asymptotically normal under coercivity conditions.
A new method de-randomizes MCMC dynamics using the Stein operator.
problem Estimating complex target distributions in Bayesian inference.
method De-randomized kernel-based particle samplers that discretize the fiber-gradient Hamiltonian flow.
result GSVGD de-randomizes complex MCMC dynamics, maintaining high sample quality.
Sparse Bayesian learning algorithm for estimating interaction kernels in Motsch-Tadmor model.
problem Data-driven identification of asymmetric interaction kernels in the Motsch-Tadmor model.
method Variational framework reformulating kernel identification as a subspace identification problem; sparse Bayesian learning algorithm with informative priors.
result Accurate, robust, and interpretable estimation of interaction kernels across various noise levels and data regimes.
Building on the line of work [DIRT15a], [DIRT15b], [NS17a], [DT17], [HLS18], [HS18] we continue the study of particle systems with singular interaction through hitting times. In contrast to the previous research, we (i) consider very general driving processes and interaction functions, (ii) allow for inhomogeneous conn…
Systems of interacting particles or agents have wide applications in many disciplines such as Physics, Chemistry, Biology and Economics. These systems are governed by interaction laws, which are often unknown: estimating them from observation data is a fundamental task that can provide meaningful insights and accurate …
Transformers approximate mean-field dynamics of indistinguishable particles.
problem Approximating the dynamics of indistinguishable particles in complex systems.
method Using transformers to model the mean-field dynamics of interacting particle systems.
result Theoretical bounds on the distance between true and transformer-obtained mean-field dynamics.
New algorithm trains latent diffusion models using interacting particles.
problem Training latent diffusion models efficiently and accurately.
method Reformulate training as minimizing a free energy functional, then approximate with interacting particles.
result The new algorithm outperforms previous methods in experiments.
We introduce a novel description of the dynamics of the order book of financial markets as that of an effective colloidal Brownian particle embedded in fluid particles. The analysis of a comprehensive market data enables us to identify all motions of the fluid particles. Correlations between the motions of the Brownian…
Electrostatics method samples complex distributions deterministically.
problem Sampling and inference of complex, high-dimensional distributions.
method Electrostatics-based particle system with Newton mechanics principles.
result Method achieves comparable performance to other methods in benchmark tasks.
Coercivity condition ensures learning of interacting particle systems.
problem Ensuring identifiability of interaction functions in learning systems of interacting particles.
method Equivalence of coercivity condition to strictly positive definiteness of an integral kernel.
result For ergodic systems, the integral kernel is strictly positive definite, satisfying the coercivity condition.
Particles representing tokens cluster in Transformers, influenced by initial tokens and matrix spectrum.
problem Understanding the geometry of learned representations in Transformers.
method Viewing Transformers as particle systems, applying dynamical systems and partial differential equations.
result Particles cluster towards limiting objects, confirming context-awareness and the emergence of leaders.
Particle- and agent-based systems are a ubiquitous modeling tool in many disciplines. We consider the fundamental problem of inferring interaction kernels from observations of agent-based dynamical systems given observations of trajectories, in particular for collective dynamical systems exhibiting emergent behaviors w…
Bayesian model learns multiscale interactions in complex systems.
problem Understanding dynamic interplay between processes at different time scales.
method Bayesian learning framework with Particle Gibbs with Ancestor Sampling (PGAS) algorithm.
result Demonstrated the effectiveness of the proposed approach through simulations.
Method learns cell interaction rules from individual trajectories.
problem Inferring interaction rules from heterogeneous cellular data.
method WSINDy for second order IPSs, learning individual cell models.
result Efficiently identifies different species and best-fit models for each.
LoRA fine-tuning causes forgetting, studied via particle system dynamics.
problem Catastrophic forgetting in LoRA fine-tuning.
method Mean-field self-attention model, partial differential equations, dynamical systems.
result Characterization of phase transitions in forgetting behavior.
Framework models multiscale dynamics with Bayesian learning for regime changes.
problem Analyzing complex interactions between fast and slow processes.
method Hierarchical state-space modeling with Sequential Monte Carlo.
result Bayesian approach accurately tracks state transitions and identifies switching dynamics.
Study identifies unique minimizers for interaction kernels in particle systems.
problem Identifying unique interaction kernels in mean-field equations of interacting particles.
method Data-adaptive L2 spaces, RKHS analysis, regularization. result Characterization of identifiability in both finite and infinite particle systems.
WSINDy identifies reduced Hamiltonian systems from particle interactions.
problem Coarse-graining Hamiltonian dynamics with approximate symmetries.
method WSINDy algorithm applied to Hamiltonian systems with timescale separation.
result WSINDy successfully identifies reduced Hamiltonian systems from noisy data.
The paper analyzes the dynamics of tokens in transformer models at moderate interaction levels.
problem Understanding the evolution of tokens in transformer models at moderate interaction levels.
method Modeling transformer models as a system of particles interacting in a mean-field way and studying the corresponding dynamics.
result Characterization and convergence of the limiting dynamics in different phases of the system.
BGNNs model particle-boundary interactions efficiently.
problem Efficiently modeling geometric boundaries in 3D simulations.
method Introduce Boundary Graph Neural Networks (BGNNs) to dynamically modify graph structures.
result BGNNs accurately reproduce 3D granular flows without handcrafted conditions.
SympFormer accelerates attention blocks using inertial dynamics on density spaces.
problem Improving the efficiency of self-attention blocks in Transformers.
method Introduced accelerated attention blocks derived from inertial Nesterov dynamics on density spaces.
result Accelerated attention blocks converge faster than classical blocks while preserving oracle calls.
New method for online learning in interacting particle systems.
problem Parameter estimation in stochastic interacting particle systems.
method Stochastic approximation of gradient of asymptotic log likelihood using continuous observations.
result Convergence to stationary points of asymptotic log-likelihood under suitable assumptions.
Extends Langevin dynamics for constrained domains.
problem Optimization of constrained probability measures.
method Mirror mean-field Langevin dynamics (MMFLD).
result Linear convergence guarantees and propagation of chaos results.
Nearly all field theories suffer from singularities when particles are introduced. This is true in both classical and quantum physics. Classical field singularities result in the notorious self-force problem, where it is unknown how the dynamics of a particle change when the particle interacts with its own (self) field…
Develops a new algorithm for estimating model parameters using interacting particle systems.
problem Estimating parameters of latent variable models.
method Interacting Particle Langevin Algorithm (IPLA) based on Langevin diffusion.
result Nonasymptotic optimisation error bounds for the estimator.