Study explores optimal strategies in games with multiple players and mean-field interactions.
problem Optimal strategies in games with multiple players and mean-field interactions.
method Exploration of three different notions of optimality, including mean-field control solution, mean-field coarse correlated equilibria, and mean-field Nash equilibria.
result Approximation of cooperative and competitive equilibria in large N-player games by mean-field control and mean-field equilibria. New method for handling multi-dimensional singular controls with jump costs in mean-field problems.
problem Handling jump costs in multi-dimensional singular controls.
method Introducing two-layer parametrisations to interpolate jumps on both distributional and pathwise levels.
result Derivation of a DPP and characterisation of the value function as a minimal super-solution to a quasi-variational inequality.
A new framework for generative modeling using controlled vector fields.
problem Expressive modeling with limited parameters.
method Continuous-time modeling with modulated fixed vector fields and learned scalar controls.
result Expressive transport achieved with a small number of learned control channels.
Deep Galerkin Method estimates value function for mean-field control problem.
problem Optimal control of agents with average welfare as the objective.
method Apply DGM to estimate value function and distribution evolution.
result Neural network approximations converge to analytical solution.
Two proofs of Kalman Theorem using flows of vector fields.
problem Classical result of Control Theory (Kalman Theorem).
method Two proofs using flows of vector fields.
result New criteria for local controllability of non-linear systems.
Study on mean field games with singular controls and their applications.
problem Optimal productivity expansion in dynamic oligopolies.
method Existence and uniqueness of mean field equilibria through nonlinear equations, Abelian limit for discounted and ergodic games.
result Valid connection between discounted and ergodic games, approximation of Nash equilibria.
New algorithm solves mean-field control problems using actor-critic learning with moment neural networks.
problem Solving mean-field control problems in continuous time reinforcement learning.
method Gradient-based policy and value function learning with moment neural networks on the Wasserstein space.
result Effective solution for diverse mean-field control problems, including multi-dimensional and nonlinear settings.
In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance function…
New approach finds solutions to games with unbounded controls.
problem Existence of equilibrium in mean-field games with unbounded controls.
method Weak formulation and new existence/stability results for quadratic-growth generalized McKean-Vlasov BSDEs.
result Existence of equilibrium result for non-Markovian mean-field games with unbounded control space.
Study Transformer layers under cross-entropy training using mean field control.
problem Understanding the behavior of Transformer layers in cross-entropy training.
method Continuous-depth mean field control analysis, treating depth as time and layer parameters as controls.
result Derivation of a Pontryagin condition for the limiting population problem, involving the softmax residual.
We establish a stochastic maximum principle (SMP) for control problems of partially observed diffusions of mean-field type with risk-sensitive performance functionals.
Framework for robust control in cooperative systems with uncertain common noise.
problem Optimizing collective behavior of agents in the presence of uncertain common noise.
method Proposes a robust mean-field control framework and proves existence of optimal controls.
result Existence of optimal open-loop controls linked to a lifted robust Markov decision problem.
Study policy gradient for large-agent mean-field control and game in continuous time.
problem Optimal policy learning for large number of agents in continuous-time mean-field systems.
method Policy gradient method applied to linear-quadratic mean-field control and game models.
result Policy gradient converges to optimal solution at a linear rate for both mean-field control and game.
Research explores how interconnected systems synchronize and how to control their behavior.
problem Understanding and controlling the behavior of interconnected dynamical systems.
method Mean field games approach applied to controlled coupled oscillators.
result Developed methods to predict and influence emergent phenomena in interconnected systems.
Just as an explicit parameterisation of system dynamics by state, i.e., a choice of coordinates, can impede the identification of general structure, so it is too with an explicit parameterisation of system dynamics by control. However, such explicit and fixed parameterisation by control is commonplace in control theory…
Develops a control framework for systemic risk under uncertainty.
problem Systemic risk under model uncertainty.
method Linear-quadratic mean-field control framework with viscosity solutions and verification theorems.
result Explicit feedback controls derived from a coupled Riccati system, preserving analytical tractability.
Study uses actor-critic method for continuous-time mean-field control with entropy regularisation.
problem Continuous-time mean-field control in reinforcement learning.
method Actor-critic approach with entropy regularisation, value function alternation, and Wasserstein space parametrisation.
result Derives exact parametrisation of actor and critic functions in linear-quadratic mean-field framework.
We provide bounds on control learning error in stochastic systems.
problem Learning optimal controls in stochastic environments with uncontrolled parts.
method Dynamic programming and mean-field interpretation of neural networks.
result Non-asymptotic bounds on generalization error for stable overparametrised settings.
Proves Sard conjecture for specific distributions, controlling divergence of vector fields.
problem Proving the Sard conjecture for certain types of distributions.
method Constructs a singular distribution capturing essential abnormal lifts, proving the conjecture for rank 3 distributions in dimension 4 and generic corank 1 distributions.
result Proves the Sard conjecture for generic co-rank one distributions.
Robust Q-learning for mean-field control under Wasserstein uncertainty
problem Mean-field control under Wasserstein uncertainty
method Quantization-and-projection scheme with Wasserstein dual reformulation
result Convergence and finite-time iteration bounds
The paper solves complex control problems using neural networks.
problem Solving McKean-Vlasov control problems.
method Mean-field neural networks and algorithms based on dynamic programming and stochastic maximum principle.
result Extensive numerical results show the accuracy of the proposed algorithms.
New algorithm controls large groups of devices to match energy demand signals.
problem Controlling large populations of electrical devices to match energy demand signals.
method Developed MD-MFC algorithm for finite horizon Markovian mean field control problem.
result MD-MFC provides theoretical guarantees for convex and Lipschitz objective functions.
We show an example providing a significance in geometric control theory of the existence of the dependence locus of a system of vector fields in particular, the generic appearance of non-trivial singular trajectories embedded in the dependence locus.
The aim of this paper is to prove that a control affine system on a manifold is equivalent by diffeomorphism to a linear system on a Lie group or a homogeneous space if and only the vector fields of the system are complete and generate a finite dimensional Lie algebra. A vector field on a connected Lie group is linear …
A reinforcement learning approach prepares quantum squeezed states in open spin systems.
problem Generating non-classical states in open quantum systems with dissipation and dephasing.
method Reinforcement learning to determine optimal control pulses for spin-squeezing.
result Optimal control sequences enhance collective spin squeezing and entanglement.
Optimizes electric field to control molecule states in Hartree-Fock theory.
problem Optimizing electric field to drive molecule from initial to target state.
method Trust region optimization with gradients from adjoint state method.
result Achieves desired target states with minimal control effort.
A new method for stochastic optimal control improves accuracy over existing techniques.
problem Improving the accuracy of stochastic optimal control for noisy systems.
method Stochastic Optimal Control Matching (SOCM) using Iterative Diffusion Optimization (IDO) with path-wise reparameterization trick.
result SOCM achieves lower error than existing techniques for three out of four control problems, sometimes by an order of magnitude.
In stochastic control problems delicate issues arise when the controlled system can jump due to both exogenous shocks and endogenous controls. Here one has to specify what the controller knows when about the exogenous shocks and how and when she can act on this information. We propose to use Meyer-σ-fields as a flexi…
Exact universal interpolation property for landmark configurations in Euclidean space.
problem Representing and deforming landmark configurations through flows of vector fields.
method Explicitly describe vector fields for exact universal interpolation property in all dimensions.
result Achieve controllability by combining constant and polynomial vector fields.
This paper develops q-learning methods for mean-field control problems.
problem Continuous-time mean-field control problems with interaction between agents.
method Introduces two q-functions and devises model-free learning algorithms.
result Developed algorithms can learn optimal value functions and q-functions.
Develops a new reinforcement learning framework for complex control problems.
problem Continuous-time extended mean field control with deterministic policies.
method Model-free sensitivity formula, deterministic policy gradient, local value and advantage-rate representations.
result Demonstrates efficiency, stability, and robustness in solving complex control problems.
New framework for analyzing games with multi-dimensional singular controls and non-linear jumps.
problem Analyzing games with multi-dimensional singular controls and non-linear jump impacts.
method Probabilistic framework with novel class of MFGs (MFGs of parametrisations).
result Existence of equilibria and equivalence with MFGs of singular controls.
Unified q-learning for mean-field jump-diffusion models with unobservable population distribution.
problem Continuous-time q-learning in mean-field jump-diffusion models with unobservable population distribution.
method Proposed decoupled Iq-function for unified policy evaluation in MFG and MFC problems; unified q-learning algorithm based on test policies and averaged martingale orthogonality condition.
result Unified policy evaluation rule for MFG and MFC problems based on decoupled Iq-function.
We compute the small time asymptotic of the fundamental solution of Hörmander's type hypoelliptic operators with drift, at a stationary point, x0, of the drift field. We show that the order of the asymptotic depends on the controllability of an associated control problem and of its approximating system. If the contr…
Stabilizes complex systems using diffusion models trained on Lyapunov functions.
problem Generating stabilizing controllers for complex dynamical systems.
method Trains a diffusion model on pairs of asymptotically stable vector fields and their Lyapunov functions to identify the closest stable field and adjust control functions.
result Efficient and rapid stabilization of unseen systems, showcasing generalizability.
fcHMRF-LIS controls FDR in neuroimaging data, improving power and scalability.
problem Complex spatial dependencies and high variability in FDR control methods for neuroimaging data.
method fcHMRF-LIS integrates LIS-based testing with fcHMRF to model spatial structures efficiently.
result fcHMRF-LIS achieves accurate FDR control, lower FNR, and higher true positives compared to existing methods.
The abstract discusses convergent realizations of Lie subalgebras in control theory.
problem Characterizing Lie subalgebras that can be realized as convergent vector fields.
method Generalizations and reformulations of algebraic properties for output realization.
result Recovery and clarification of previous results on control-affine systems and realization of Chen-Fliess series.
New method controls renewable energy storage and portfolio selection with probabilistic constraints.
problem Control of McKean-Vlasov dynamics with probabilistic state constraints.
method Level-set approach for exact penalization and running maximum/integral cost.
result Extension to mean-field setting with machine learning algorithm.
Reconstructing signature features from randomized vector fields in differential equations.
problem Reconstructing signature features from controlled differential equations with random vector fields.
method Using controlled ordinary differential equations driven by continuous bounded variation curves, the study explores the extent to which signature features can be reconstructed from the non-linear flow of these equations.
result The number of signature features that can be reconstructed from the non-linear flow of controlled ordinary differential equations with random vector fields is exponential in the hidden dimension, under certain conditions.
The purpose of this paper is to use the framework of Lie algebroids to study optimal control problems for affine connection control systems on Lie groups. In this context, the equations for critical trajectories of the problem are geometrically characterized as a Hamiltonian vector field.
The paper explores a new method for landmark matching using sub-Riemannian geometry and neural networks.
problem Finding a time-dependent vector field to warp points from an initial set to a target set.
method Sub-Riemannian geometry and residual neural networks.
result Demonstrates the importance of regularization in landmark matching.
Study approximates operators on labelled conditional distributions for non-exchangeable systems.
problem Approximating operators on constrained probability measures for non-exchangeable systems.
method Combines cylindrical approximations and DeepONet-type neural architecture for finite-dimensional representations.
result Establishes a universal approximation theorem for continuous operators on Mλ. Federated learning linked to mean-field games for large-scale learning.
problem Large-scale distributed and privacy-preserving learning algorithms.
method Established a connection between federated learning and mean-field games, presenting federated learning as a differential game.
result Properties of the equilibrium of the federated learning game were discussed.
Topology guidance controls generative model outputs by specifying topological features.
problem Lack of control in generative models for visual analysis.
method Coupling a coordinate-based neural network with a diffusion model to guide sampling.
result Generated fields adhere to specified topological features while staying within the generative distribution.
Let (Mn,g) be an n-dimensional compact connected Riemannian manifold with smooth boundary. We show that the presence of a nontrivial conformal gradient vector field on M, with an appropriate control on the Ricci curvature makes M to be isometric to a hemisphere of Sn. We also prove that if an Ein…
Develops a new exponential map for time-varying vector fields.
problem Lack of global flows for general time-varying vector fields.
method Categorical development of spaces of vector fields and flows, allowing for systematic localisation.
result Derives the homeomorphism of the exponential map for vector fields with measurable time-dependence.
This paper contains a summary of mathematical researches of stochastic properties of the long time behavior of a continuously observed (and interactively controlled) quantum--field top. Applications to interactively controlled stochastic computer-graphic dynamical systems are also discussed.
New methods prove controllability of non-linear systems, extending classical results.
problem Controllability of non-linear control systems.
method Analytic control system, graph completions, flows of vector fields, pseudogroup of local diffeomorphisms.
result Sufficient conditions for local controllability and accessibility of non-linear systems.