A new method relaxes molecules without needing non-equilibrium data.
problem Molecular relaxation requires understanding non-equilibrium structures.
method MoreRed: molecular relaxation by reverse diffusion with time step prediction.
result MoreRed learns a simpler pseudo potential energy surface.
Deep neural network generates molecular structures close to equilibrium.
problem Discovery of atomistic systems with desirable properties.
method Autoregressive, convolutional deep neural network architecture.
result Model generates molecules close to equilibrium for C7O2H10 isomers.
New model outperforms Neural ODEs while being more efficient.
problem Stable convergence and existence guarantees for implicit-depth models.
method Developed Monotone Operator Equilibrium Network (monDEQ) based on monotone operator theory.
result MonDEQ models outperform Neural ODEs and are more computationally efficient.
Analyzes how financial network dependencies can lead to multiple equilibrium outcomes and optimal bailout strategies.
problem Multiple equilibrium outcomes in financial networks due to dependency cycles.
method Characterized necessary and sufficient conditions for bank solvency, and provided upper bounds on optimal bailout payments.
result Minimum bailout payments needed to ensure systemic solvency and prevent cascading defaults.
New learning algorithm mimics biological neural networks.
problem Biologically implausible backpropagation for directed neural networks.
method Introduces new neuronal dynamics and learning rule for arbitrary architectures, sparsity-inducing pruning method, and dynamical-systems characterization.
result Prunes irrelevant connections and improves learning efficiency.
Neural network models colloidal particle dynamics in non-equilibrium systems.
problem Analyzing non-equilibrium dynamics of many-body colloidal systems.
method Combining power functional theory and machine learning, training a neural network to predict internal force fields.
result The neural network accurately predicts dynamics in non-equilibrium systems, in good agreement with simulations.
Path-independent equilibrium models improve network performance on harder problems.
problem Improving network performance on harder problem instances.
method Investigated path-independent equilibrium models and their impact on network performance.
result Path independence correlates with better performance on harder problem instances.
The paper introduces Robust Correlated Equilibrium for games with time-varying costs and proposes an algorithm to achieve it.
problem Games with time-varying costs and disturbances.
method Proposes Robust Correlated Equilibrium and a decentralized algorithm to learn optimal strategies.
result The algorithm converges to the Robust Correlated Equilibrium, showing no regret for each controller.
DDEQs extend DEQs to discrete measure inputs using Wasserstein gradient flows.
problem Applying DEQs to discrete measure inputs like sets or point clouds.
method Wasserstein gradient flows for finding fixed points of discrete measures under permutation-invariance.
result DDEQs can compete with state-of-the-art models in tasks like point cloud classification and completion.
Study reveals dynamics of neural networks with normalization, weight decay, and SGD.
problem Understanding the equilibrium condition in Spherical Motion Dynamics (SMD).
method Investigates SMD by exploring the cause of equilibrium condition, introducing assumptions, proposing angular update, and verifying theoretical results.
result Proves weight norm and angular update can converge at linear rate under given assumptions.
Proposes a new optimization-based method for aggregating sets in neural networks.
problem Limited representational power of existing aggregation methods.
method Equilibrium Aggregation: an optimization-based approach.
result Equilibrium Aggregation outperforms existing methods in various tasks.
DEQ models find equilibrium points for efficient deep learning.
problem Efficiently modeling sequential data with reduced memory usage.
method Directly find equilibrium points in an infinite depth feedforward network using implicit differentiation.
result DEQs often improve performance and reduce memory consumption compared to existing models.
The paper examines Nash equilibrium in GANs for stationary Gaussian processes.
problem Existence and uniqueness of Nash equilibrium in GANs for stationary Gaussian processes.
method Analyzes the existence of Nash equilibrium in GANs for stationary Gaussian processes, considering different discriminator families.
result The existence of Nash equilibrium depends on the discriminator family and symmetry properties of the generator family.
Deep equilibrium models estimate latent variables from data.
problem Estimating latent variables from data.
method Generalized exponential family models, deep equilibrium networks.
result Deep equilibrium models solve MAP estimates for latent and transformation parameters.
Economic integration, globalization and financial crises represent examples of processes whose understanding requires the analysis of the underlying network structure. Of particular interest is establishing whether a real economic network is in a state of (quasi)stationary equilibrium, i.e. characterized by smooth stru…
This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a reinforcement learning (adaptive filtering) algorithm that facilitates learning…
Neural nets improve plasma equilibrium modeling for NSTX-U.
problem Modeling plasma equilibrium and shape control for NSTX-U.
method Developed two neural networks: Eqnet and Pertnet.
result NNs offer faster and more flexible prediction of plasma scenarios.
Deep learning models replicate Kyle's model's market equilibrium.
problem Understanding market equilibria in asymmetric information settings.
method Using deep neural networks to model agents in Kyle's single period model.
result Trained networks' behavior converges to Kyle's predicted equilibrium.
Wide neural networks converge to Gaussian processes, improving generalization.
problem Understanding the generalization of wide neural networks, especially deep equilibrium models.
method Investigation of deep equilibrium models (DEQs) with infinite-depth layers, focusing on their convergence to Gaussian processes as width and depth approach infinity.
result Wide DEQs converge to Gaussian processes, maintaining generalization performance.
We perform a geometric study of the equilibrium locus of the flow that models the diffusion process over a circular network of cells. We prove that when considering the set of all possible values of the parameters, the equilibrium locus is a smooth manifold with corners, while for a given value of the parameters, it is…
Improves GANs training through game theory.
problem Hard training of GANs due to antagonistic networks.
method Rewrote GAN training as a variational inequality and introduced a stochastic relaxed forward-backward algorithm.
result Algorithm converges to an exact solution or a neighborhood of it under monotonicity.
ERNNs evolve hidden states on an ODE's equilibrium manifold to mitigate vanishing and exploding gradients.
problem Vanishing and exploding gradients in RNNs.
method Develop a novel family of RNNs (ERNNs) that evolve hidden states on the equilibrium manifold of an ODE.
result ERNNs achieve state-of-the-art accuracy with 3-10x speedups and 1.5-3x model size reduction.
Deep neural network solves large multi-agent games for Markovian Nash equilibrium.
problem Finding Markovian Nash equilibrium in large multi-agent stochastic differential games.
method Reformulate as decoupled decision problems, solve iteratively using deep BSDE method.
result Proposed algorithm accurately finds Nash equilibrium in large games.
GANs may not have Nash equilibria, but proximal training can find solutions.
problem Existence of Nash equilibria in GANs optimization.
method Proximal training approach to find solutions.
result Proximal training finds solutions to GAN problems.
New method stabilizes DEQ models by regularizing Jacobian of fixed-point equations.
problem Stability and performance of DEQ models.
method Jacobian regularization to stabilize DEQ models.
result Significant stabilization of fixed-point convergence in DEQ models.
A major line of contemporary research on complex networks is based on the development of statistical models that specify the local motifs associated with macro-structural properties observed in actual networks. This statistical approach becomes increasingly problematic as network size increases. In the context of curre…
In optimization, the negative gradient of a function denotes the direction of steepest descent. Furthermore, traveling in any direction orthogonal to the gradient maintains the value of the function. In this work, we show that these orthogonal directions that are ignored by gradient descent can be critical in equilibri…
This paper studies how relative performance concerns affect stock prices in a tree-like market model.
problem The impact of relative performance concerns on stock prices in a tree-like market model.
method Mean-field equilibrium analysis in a binomial tree framework with exponential utility.
result Existence and uniqueness of market-clearing mean-field equilibrium in both single- and multi-population settings.
Boltzmann Generators use deep learning to efficiently sample complex systems.
problem Sampling equilibrium states in many-body systems like proteins is computationally challenging.
method Combining deep learning and statistical mechanics, Boltzmann Generators learn a coordinate transformation to generate unbiased samples.
result Boltzmann Generators can generate one-shot equilibrium samples of complex systems and proteins.
Machine learning detects tipping points in complex systems.
problem Detecting abrupt shifts in complex dynamical systems.
method Equilibrium-informed neural networks (EINNs) trained on candidate equilibrium states.
result EINNs can identify critical thresholds in nonlinear systems.
New method generates equilibrium glass configurations efficiently.
problem Sampling equilibrium configurations of amorphous materials is slow and difficult.
method Riemannian stochastic interpolation framework combining Riemannian stochastic interpolant and equivariant flow matching.
result Enforcing geometric and symmetry constraints significantly improves generative performance.
Save for some special cases, current training methods for Generative Adversarial Networks (GANs) are at best guaranteed to converge to a `local Nash equilibrium` (LNE). Such LNEs, however, can be arbitrarily far from an actual Nash equilibrium (NE), which implies that there are no guarantees on the quality of the found…
DEQs and explicit networks are nearly equivalent for Gaussian mixtures.
problem Understanding the equivalence between DEQs and explicit neural networks.
method Random matrix theory and analysis of kernel matrices.
result A shallow explicit network can mimic the kernel of a DEQ.
We show that training of generative adversarial network (GAN) may not have good generalization properties; e.g., training may appear successful but the trained distribution may be far from target distribution in standard metrics. However, generalization does occur for a weaker metric called neural net distance. It is a…
This paper provides a general framework for modeling financial contagion in a system with obligations in multiple illiquid assets (e.g., currencies). In so doing, we develop a multi-layered financial network that extends the single network of Eisenberg and Noe (2001). In particular, we develop a financial contagion mod…
New theorem guarantees approximate equilibrium in non-convex games.
problem No guarantee of equilibrium in non-convex games.
method Introduced a minimax theorem for non-convex games involving neural networks.
result Provided an approximate minimax theorem for non-convex games.
Kernel networks' stability edge linked to Fisher Information singularity.
problem Understanding the stability edge in high-capacity kernel Hopfield networks.
method Statistical manifold analysis and Riemannian geometry.
result The Ridge of Optimization corresponds to the Edge of Stability, revealing a dual equilibrium.
We propose a new equilibrium enforcing method paired with a loss derived from the Wasserstein distance for training auto-encoder based Generative Adversarial Networks. This method balances the generator and discriminator during training. Additionally, it provides a new approximate convergence measure, fast and stable t…
Quantum computing aids in predicting financial crashes.
problem Predicting financial crashes when markets are disrupted.
method Mapped financial network to quantum Hamiltonian, solved using quantum annealing.
result Quantum computing can efficiently assess financial equilibrium and predict crashes.
A new method uses deep learning to predict rare events in complex systems.
problem Predicting rare and extreme events in non-equilibrium systems.
method A deep learning approach that minimizes the geometrical action.
result The method accurately predicts rare events in various complex systems.
We represent an exchange economy in terms of statistical ensembles for complex networks by introducing the concept of market configuration. This is defined as a sequence of nonnegative discrete random variables {wij} describing the flow of a given commodity from agent i to agent j. This sequence can be arran…
New parameterization of neural networks with Lipschitz bounds for robustness.
problem Developing robust neural networks with Lipschitz bounds.
method Introducing a new parameterization that admits a Lipschitz bound during training without requiring projections or barrier functions.
result The new parameterization improves robustness to adversarial attacks in image classification.
New model for recovering unverifiable signals from observers in decentralized networks.
problem Verifying the level of service provided by untrusted parties in decentralized networks.
method Formal model of signal elicitation, source identifiability condition, and peer prediction techniques.
result Existence of a strictly truthful mechanism for unverifiable signal recovery.
Introduces strong equilibrium for time-inconsistent stopping problems in continuous time.
problem Time-inconsistent stopping problems in continuous time.
method Introduces strong equilibrium, compares with existing mild and weak equilibria, and provides an iteration method to construct optimal mild equilibria.
result Optimal mild equilibria are always strong equilibria under certain conditions.
EP algorithm improved for CNNs and real-time learning.
problem EP's long simulation times and non-local learning rule limitations.
method Discrete-time formulation, continual weight updates, local time information.
result C-EP achieves best performance on MNIST with CNNs.
Model predicts asset prices from initial shocks using neural networks.
problem Missing data on actual asset liquidations limits model calibration.
method Dual neural network structure, first stage maps shocks to liquidations, second stage uses liquidations to predict prices.
result Model accurately predicts equilibrium prices from initial shocks without liquidation data.
Model shows phase transitions in asset pricing with market maker incentives.
problem Analyzing asset pricing with market maker profit incentives.
method Stochastic game theory, neural networks.
result Equilibrium experiences three phases: linear pricing, mid-price with spread, and metastable state.
Gradient methods converge exponentially in concave network games.
problem Finding Nash equilibria in concave network zero-sum games.
method Gradient Ascent and Optimistic Gradient Ascent analyses.
result Exponential convergence rates in various game settings.