This paper addresses metaconsistency in Bayesian inference for metastable systems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Learn true model from metastable samples of discrete distributions.
New methods use machine learning to simulate rare transitions in molecular systems.
New method detects metastable basins in high dimensions using trajectory sampling.
The committor function is a central object of study in understanding transitions between metastable states in complex systems. However, computing the committor function for realistic systems at low temperatures is a challenging task, due to the curse of dimensionality and the scarcity of transition data. In this paper,…
We propose a deep generative Markov State Model (DeepGenMSM) learning framework for inference of metastable dynamical systems and prediction of trajectories. After unsupervised training on time series data, the model contains (i) a probabilistic encoder that maps from high-dimensional configuration space to a small-siz…
New method clusters directed graphs using Koopman operators.
ISOKANN learns collective variables and effective dynamics for metastable transitions.
Develops methods to simulate rare transitions in molecular systems.
Discovering quasipotential equations from data using machine learning.
This paper studies how to find compact state embeddings from high-dimensional Markov state trajectories, where the transition kernel has a small intrinsic rank. In the spirit of diffusion map, we propose an efficient method for learning a low-dimensional state embedding and capturing the process's dynamics. This idea a…
A new framework uses stochastic optimal control to estimate rare events more accurately.
We introduce a machine learning approach for extracting fine-grained representations of protein evolution from molecular dynamics datasets. Metastable switching linear dynamical systems extend standard switching models with a physically-inspired stability constraint. This constraint enables the learning of nuanced repr…
RC flow learns molecular kinetics in low dimensions.
Efficiently simulates slow dynamics of high-dimensional stochastic systems.
Proves triviality of inertia groups in high-dimensional manifolds.
Lipid necks, large curvature bridges, are shown to be metastable.
Timewarp accelerates molecular dynamics by learning to simulate long timescales.
Study shows bifurcating price dynamics in ASME with traders.
This paper is on the classical Knotting Problem: for a given manifold N and a number m describe the set of isotopy classes of embeddings . We study the specific case of knotted tori, i. e. the embeddings . The classification of knotted tori up to isotopy in the metastable dimension ran…
Stochastic gradient descent (SGD) has been widely used in machine learning due to its computational efficiency and favorable generalization properties. Recently, it has been empirically demonstrated that the gradient noise in several deep learning settings admits a non-Gaussian, heavy-tailed behavior. This suggests tha…
The paper studies how search and distillation improve reasoning in large language models.
We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework for the computation of optimal reaction coordinates of such systems that is based …
Study shows social reinforcement learning can lead to persistent but metastable polarization.
New method controls mean exit time in stochastic systems using machine learning and quasipotential.
New method makes machine learning approximations unbiased and efficient.
An algorithmically hard phase was described in a range of inference problems: even if the signal can be reconstructed with a small error from an information theoretic point of view, known algorithms fail unless the noise-to-signal ratio is sufficiently small. This hard phase is typically understood as a metastable bran…
Recent years have seen rapid advances in the data-driven analysis of dynamical systems based on Koopman operator theory and related approaches. On the other hand, low-rank tensor product approximations -- in particular the tensor train (TT) format -- have become a valuable tool for the solution of large-scale problems …
Study of phase separation and geometry on a closed elastic curve, including dynamics and free energy minimization.
We analyze wealth condensation for a wide class of stochastic economy models on the basis of the economic analog of thermodynamic potentials, termed transfer potentials. The economy model is based on three common transfers modes of wealth: random transfer, profit proportional to wealth and motivation of poor agents to …
Develops a machine learning framework for computing most probable paths in stochastic systems.
We study the detailed path-wise behavior of the discrete-time Langevin algorithm for non-convex Empirical Risk Minimization (ERM) through the lens of metastability, adopting some techniques from Berglund and Gentz (2003. For a particular local optimum of the empirical risk, with an arbitrary initialization, we show tha…
DOODL learns shared spectral dynamics across related dynamical systems.
Algorithm learns stochastic system dynamics from data.
Technological progress is leading to proliferation and diversification of trading venues, thus increasing the relevance of the long-standing question of market fragmentation versus consolidation. To address this issue quantitatively, we analyse systems of adaptive traders that choose where to trade based on their previ…
Motivated by Tverberg-type problems in topological combinatorics and by classical results about embeddings (maps without double points), we study the question whether a finite simplicial complex K can be mapped into R^d without higher-multiplicity intersections. We focus on conditions for the existence of almost r-embe…
Given Poincare spaces M and X, we study the possibility of compressing embeddings of M x I in X x I down to embeddings of M in X. This results in a new approach to embedding in the metastable range both in the smooth and Poincare duality categories.
Deep reinforcement learning method finds rare events in complex systems.
An image pattern can be represented by a probability distribution whose density is concentrated on different low-dimensional subspaces in the high-dimensional image space. Such probability densities have an astronomical number of local modes corresponding to typical pattern appearances. Related groups of modes can join…
In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. I…
In this paper we first analyzed the inductive bias underlying the data scattered across complex free energy landscapes (FEL), and exploited it to train deep neural networks which yield reduced and clustered representation for the FEL. Our parametric method, called Information Distilling of Metastability (IDM), is end-t…
Study improves policy search in continuous control by using heavy-tailed distributions.
The purpose of this note is to attract attention to the following conjecture (metastable -fold Whitney trick) by clarifying its status as not having a complete proof, in the sense described in the paper. Assume that is disjoint union of disks of dimension , a proper …
Spin-glasses are universal models that can capture complex behavior of many-body systems at the interface of statistical physics and computer science including discrete optimization, inference in graphical models, and automated reasoning. Computing the underlying structure and dynamics of such complex systems is extrem…
Understanding complex systems with their reduced model is one of the central roles in scientific activities. Although physics has greatly been developed with the physical insights of physicists, it is sometimes challenging to build a reduced model of such complex systems on the basis of insights alone. We propose a nov…
This paper extends transfer operator theory to McKean-Vlasov equations.
Let EMBED(k,d) be the following algorithmic problem: Given a finite simplicial complex K of dimension at most k, does there exist a (piecewise linear) embedding of K into R^d? Known results easily imply polynomiality of EMBED(k,2) (k=1,2; the case k=1, d=2 is graph planarity) and of EMBED(k,2k) for all k>2 (even if k i…
We consider Lagrangian coherent structures (LCSs) as the boundaries of material subsets whose advective evolution is metastable under weak diffusion. For their detection, we first transform the Eulerian advection-diffusion equation to Lagrangian coordinates, in which it takes the form of a time-dependent diffusion or h…