A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
BNEM improves Boltzmann sampler efficiency.
Deep learning approximates system moments from data.
The paper develops a new algorithm for RBMs using dynamical mean-field theory.
Within the description of stochastic differential equations it is argued that the existence of Boltzmann-Gibbs type distribution in economy is independent of the time reversal symmetry in econodynamics. Both power law and exponential distributions can be accommodated by it. The demonstration is based on a mathematical …
Dynamic Boltzmann Machine (DyBM) has been shown highly efficient to predict time-series data. Gaussian DyBM is a DyBM that assumes the predicted data is generated by a Gaussian distribution whose first-order moment (mean) dynamically changes over time but its second-order moment (variance) is fixed. However, in many fi…
We study historical dynamics of joint equilibrium distribution of stock returns in the U.S. stock market using the Boltzmann distribution model being parametrized by external fields and pairwise couplings. Within Boltzmann learning framework for statistical inference, we analyze historical behavior of the parameters in…
Transferable Boltzmann Generators learn to sample unseen molecules efficiently.
Computing equilibrium states in condensed-matter many-body systems, such as solvated proteins, is a long-standing challenge. Lacking methods for generating statistically independent equilibrium samples in "one shot", vast computational effort is invested for simulating these system in small steps, e.g., using Molecular…
We propose a particularly structured Boltzmann machine, which we refer to as a dynamic Boltzmann machine (DyBM), as a stochastic model of a multi-dimensional time-series. The DyBM can have infinitely many layers of units but allows exact and efficient inference and learning when its parameters have a proposed structure…
D-Wave computers struggle with sampling Boltzmann distributions efficiently.
Flow AIS Bootstrap improves flow training by generating samples in hard-to-reach regions.
Value function estimation is an important task in reinforcement learning, i.e., prediction. The Boltzmann softmax operator is a natural value estimator and can provide several benefits. However, it does not satisfy the non-expansion property, and its direct use may fail to converge even in value iteration. In this pape…
A new method speeds up sampling of Boltzmann distribution in high-dimensional systems.
Timewarp accelerates molecular dynamics by learning to simulate long timescales.
A deterministic system of interacting agents is considered as a model for economic dynamics. The dynamics of the system is described by a coupled map lattice with near neighbor interactions. The evolution of each agent results from the competition between two factors: the agent's own tendency to grow and the environmen…
We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to combinatorial explosion of the sample space, TBMs overcome the problem by adaptively …
EDG generates Boltzmann samples from latent variables efficiently.
CAP-BM learns complex-valued data's amplitude and phase distributions.
In this communication, complex systems with a near trivial dynamics are addressed. First, under the hypothesis of equiprobability in the asymptotic equilibrium, it is shown that the (hyper) planar geometry of an -dimensional multi-agent economic system implies the exponential (Boltzmann-Gibss) wealth distribution an…
Jeffreys Flow improves robustness of Boltzmann generators for rare event sampling.
Quantum Boltzmann Machines trained on quantum annealers produce noisy synthetic data.
Statistical models of economic distributions lead to Boltzmann distributions rather than a Pareto power law. This result is supported by two facts: 1. the distributions of income, car sales, marriages or jobs are a matter of chances and luck and not of reason! 2. Data for property, automobile sales, marriages and job m…
In emissions trading, the initial allocation of permits is an intractable issue because it needs to be essentially fair to the participating countries. There are many ways to distribute a given total amount of emissions permits among countries, but the existing distribution methods, such as auctioning and grandfatherin…
Statistical mechanics explains income and wealth distribution in developed economies.
This paper provides a tutorial on Boltzmann Machines and Deep Belief Networks.
Using a model based on generalised Lotka Volterra dynamics together with some recent results for the solution of generalised Langevin equations, we show that the equilibrium solution for the probability distribution of wealth has two characteristic regimes. For large values of wealth it takes the form of a Pareto style…
We develop an efficient sampling method by simulating Langevin dynamics with an artificial force rather than a natural force by using the gradient of the potential energy. The standard technique for sampling following the predetermined distribution such as the Gibbs-Boltzmann one is performed under the detailed balance…
Boltzmann machines are powerful distributions that have been shown to be an effective prior over binary latent variables in variational autoencoders (VAEs). However, previous methods for training discrete VAEs have used the evidence lower bound and not the tighter importance-weighted bound. We propose two approaches fo…
EWFM trains continuous flows with only energy evaluations, improving sample quality with fewer computations.
This work maps Boltzmann distributions to ARNNs for better physics-based model approximations.
New method combines deep learning and quantum mechanics for efficient molecular statistics.
We show that deep narrow Boltzmann machines are universal approximators of probability distributions on the activities of their visible units, provided they have sufficiently many hidden layers, each containing the same number of units as the visible layer. We show that, within certain parameter domains, deep Boltzmann…
There are many advantages to use probability method for nonlinear system identification, such as the noises and outliers in the data set do not affect the probability models significantly; the input features can be extracted in probability forms. The biggest obstacle of the probability model is the probability distribu…
The Boltzmann machine provides a useful framework to learn highly complex, multimodal and multiscale data distributions that occur in the real world. The default method to learn its parameters consists of minimizing the Kullback-Leibler (KL) divergence from training samples to the Boltzmann model. We propose in this wo…
DECAF optimizes molecular graphs for ensemble properties, improving drug design accuracy.
New method generates molecular conformations efficiently.
Quantum annealing (QA) is a hardware-based heuristic optimization and sampling method applicable to discrete undirected graphical models. While similar to simulated annealing, QA relies on quantum, rather than thermal, effects to explore complex search spaces. For many classes of problems, QA is known to offer computat…
The Unlearning algorithm improves neural network performance in memory tasks.
We describe discrete restricted Boltzmann machines: probabilistic graphical models with bipartite interactions between visible and hidden discrete variables. Examples are binary restricted Boltzmann machines and discrete naive Bayes models. We detail the inference functions and distributed representations arising in th…
Computational Fluid Dynamics (CFD) is a hugely important subject with applications in almost every engineering field, however, fluid simulations are extremely computationally and memory demanding. Towards this end, we present Lat-Net, a method for compressing both the computation time and memory usage of Lattice Boltzm…
We discuss the equivalence between kinetic wealth-exchange models, in which agents exchange wealth during trades, and mechanical models of particles, exchanging energy during collisions. The universality of the underlying dynamics is shown both through a variational approach based on the minimization of the Boltzmann e…
Two sets of high quality income data are analysed in detail, one set from the UK, one from the USA. It is firstly demonstrated that both a log-normal distribution and a Boltzmann distribution can give very accurate fits to both these data sets. The absence of a power tail in the US data set is then discussed. Taken in …
Enhances hashing for fast retrieval with correlated bits.
Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where…
We develop a general framework, based on Boltzmann transport theory, to analyze the distribution of wealth in societies. Within this framework we derive the distribution function of wealth by using a two-party trading model for the poor people while for the rich people a new model is proposed where interaction with wea…
Conditional restricted Boltzmann machines are undirected stochastic neural networks with a layer of input and output units connected bipartitely to a layer of hidden units. These networks define models of conditional probability distributions on the states of the output units given the states of the input units, parame…
Boltzmann machines are physics informed generative models with wide applications in machine learning. They can learn the probability distribution from an input dataset and generate new samples accordingly. Applying them back to physics, the Boltzmann machines are ideal recommender systems to accelerate Monte Carlo simu…
Neural Boltzmann Machines improve on CRBMs for modeling data.