Inverse problem solved for relativistic Boltzmann equation on spacetime.
problem Determining spacetime from causal measurements.
method Using the nonlinearity of the Boltzmann equation to uniquely determine the spacetime.
result The spacetime is uniquely determined up to isometry in the causal set I+(x−)∩I−(x+). In recent work, Boltzmann and Fokker-Planck equations were derived for the "Yard-Sale Model" of asset exchange. For the version of the model without redistribution, it was conjectured, based on numerical evidence, that the time-asymptotic state of the model was oligarchy -- complete concentration of wealth by a single …
In 1870s, L. Boltzmann proved the famous H-theorem for the Boltzmann equation in the kinetic theory of gas and gave the statistical interpretation of the thermodynamic entropy. In 2002, G. Perelman introduced the notion of W-entropy and proved the W-entropy formula for the Ricci flow. This plays a crucial role in…
Paper proposes an effective mean-field inference method for NNBMs.
problem Inference in NNBMs is challenging due to their complex structure.
method Uses mean-field method and diagonal consistency method.
result Effective inference method for NNBMs is proposed.
A new training method for normalizing flows without samples.
problem Training normalizing flows without samples but with energy functions.
method Interpolates energy functions to find a transport vector field.
result Optimizes transport vector field and energy function to satisfy continuity equation.
We briefly review results on nonlinear kinetic equation of Boltzmann type which describe the evolution of wealth in a simple agents market. The mathematical structure of the underlying kinetic equations allows to use well-known techniques of wide use in kinetic theory of rarefied gases to obtain information on the proc…
In this paper we introduce kinetic equations for the evolution of the probability distribution of two goods among a huge population of agents. The leading idea is to describe the trading of these goods by means of some fundamental rules in price theory, in particular by using Cobb-Douglas utility functions for the bina…
A simplified model shows how wealth distribution can be derived from random exchanges.
problem Understanding wealth inequality and its distribution over time.
method Stylized random exchange model, Markov chain, discrete and continuous stochastic processes, Boltzmann-type kinetic equations.
result Existence of equilibrium distribution in the stylized model.
EDG generates Boltzmann samples from latent variables efficiently.
problem Sampling from complex energy functions in high dimensions.
method Combines variational autoencoders and diffusion models; uses a decoder and diffusion-based encoder.
result EDG outperforms existing methods in various sampling tasks.
Modeling high-frequency traders' behavior in financial markets using microscopic dynamics.
problem Capturing the collective motion of high-frequency traders in financial markets.
method Developed a microscopic model based on direct observation of HFTs' trajectories and derived Boltzmann-like and Langevin-like equations.
result First microscopic model validated through data analysis, exhibiting quantitative agreements with empirical results.
Paper explores Monge-Ampère in deep learning and quantum geometry.
problem Understanding the Monge-Ampère equation in deep learning.
method Review of Boltzmann learning, connection to optimal transport, insights from quantum geometry, renormalization group flow.
result Space of covariance matrices in learning dynamics coincides with the CAH cone.
Within the description of stochastic differential equations it is argued that the existence of Boltzmann-Gibbs type distribution in economy is independent of the time reversal symmetry in econodynamics. Both power law and exponential distributions can be accommodated by it. The demonstration is based on a mathematical …
Deep learning approximates system moments from data.
problem Approximating moments of spatial probabilistic systems.
method Dynamic Boltzmann Distributions (DBDs) with deep Boltzmann machines (DBMs).
result Learned moment closures improve generalization over traditional methods.
The study analyzes the evolution of Gaussian measures under a specific gradient flow.
problem Analyzing the evolution of Gaussian measures under a specific gradient flow.
method Derives ordinary differential equations governing the evolution of mean, covariance, and mass under the HK-Boltzmann gradient flow.
result Exponential convergence to equilibrium demonstrated through Polyak-Lojasiewicz-type inequalities.
Kinetic models predict speculators' strategy can affect market prices.
problem Understanding how speculators' behavior affects market prices in a multi-agent exchange system.
method Developed kinetic equations to model interactions between dealers and speculators, using utility functions and mean quantities.
result Speculators' strategy can drive the price of goods towards a zone with marked utility for their group.
VT-DIS improves sampling from Boltzmann distributions with minimal overhead.
problem Bias in Monte Carlo estimates from score-based diffusion models.
method Variance-Tuned Diffusion Importance Sampling (VT-DIS) adapts noise covariance to correct bias.
result VT-DIS achieves effective sample sizes of 80%, 35%, and 3.5% on benchmarks, using less computational budget.
We introduce and discuss a nonlinear kinetic equation of Boltzmann type which describes the influence of knowledge in the evolution of wealth in a system of agents which interact through the binary trades introduced in Cordier, Pareschi, Toscani, J. Stat. Phys. 2005. The trades, which include both saving propensity and…
A new method uses RBMs to handle incomplete multi-output data.
problem Handling incomplete multi-output data with dependencies between features and labels.
method Adapted RBM algorithm based on mean-field equations for joint imputation and classification.
result Efficiently solves problems with missing features and labels.
Transferable Boltzmann Generators learn to sample unseen molecules efficiently.
problem Generating equilibrium samples of molecular systems.
method Boltzmann Generators using normalizing flows to learn transformations.
result Transferable Boltzmann Generators can predict zero-shot Boltzmann distributions for unseen molecules.
Conditional probabilities modeled using Riemann-Theta Boltzmann Machines.
problem Modeling conditional probabilities in Boltzmann machines.
method Deriving conditional density functions from Riemann-Theta Boltzmann machines.
result Conditional densities can be directly inferred from Riemann-Theta Boltzmann machines.
Study heat flows on time-dependent metric measure spaces, proving properties related to super-Ricci flows.
problem Characterize heat flows and their properties on time-dependent metric measure spaces.
method Prove existence, uniqueness, and regularity of heat equations and their duals on time-dependent metric measure spaces.
result Equivalence of dynamic convexity of Boltzmann entropy, monotonicity of Wasserstein distances, gradient estimates, and Bochner inequality.
Kinetic theory explains financial Brownian motion from trader dynamics.
problem Understanding financial Brownian motion from high-frequency trading dynamics.
method Deriving time-evolution equations, Bogoliubov-Born-Green-Kirkwood-Yvon hierarchies, Boltzmann-like and Langevin-like equations.
result Mathematical foundation for financial Brownian motion parallels physical Brownian motion.
We derive a mesoscopic description of the behavior of a simple financial market where the agents can create their own portfolio between two investment alternatives: a stock and a bond. The model is derived starting from the Levy-Levy-Solomon microscopic model (Econ. Lett., 45, (1994), 103--111) using the methods of kin…
TBMs learn Gibbs distribution adaptively from data.
problem Combinatorial explosion in Boltzmann machines.
method Adaptive construction of minimum required sample space.
result TBMs outperform other Boltzmann machines in efficiency and effectiveness.
D-Wave computers struggle with sampling Boltzmann distributions efficiently.
problem Sampling Boltzmann distributions efficiently on D-Wave computers.
method Exploring various obstacles and remaining difficulties.
result Challenges remain in using D-Wave computers for efficient sampling.
In this note we determine the first two derivatives of the classical Boltzmann-Shannon entropy of the conjugate heat equation on general evolving manifolds. Based on the second derivative of the Boltzmann-Shannon entropy, we construct Perelman's F and W entropy in abstract geometric flows. Monotonicity of the entropies…
Enhances knot counting invariant using biquasile Boltzmann weights.
problem Differentiating links with the same counting invariant.
method Introducing biquasile Boltzmann weights and identifying conditions for linear functions to be Boltzmann weights.
result Identifies proper enhancement of knot counting invariant.
Quantum Boltzmann Machines trained on quantum annealers produce noisy synthetic data.
problem Training quantum Boltzmann machines on quantum annealers for financial data generation.
method Used D-Wave Advantage 4.1 quantum annealer to train QBMs and compare with classical RBMs.
result Quantum Boltzmann Machines trained on quantum annealers are noisier and less effective than classical RBMs.
Improved discrete VAEs using relaxed Boltzmann priors for better performance.
problem Training discrete VAEs with tighter importance-weighted bounds.
method Two approaches for relaxing Boltzmann machines to continuous distributions, based on generalized overlapping transformations and the Gaussian integral trick.
result These relaxations outperform previous discrete VAEs with Boltzmann priors on MNIST and OMNIGLOT datasets.
Boltzmann machines can discover new cluster Monte Carlo algorithms.
problem Discovering new cluster Monte Carlo algorithms for complex systems.
method Using Boltzmann machines to learn and generate samples from physical systems, identifying clusters.
result Boltzmann machines can discover unknown cluster Monte Carlo algorithms.
A weak law of large numbers is established for a sequence of systems of N classical point particles with logarithmic pair potential in $\bbR^n$, or $\bbS^n$, $n\in \bbN$, which are distributed according to the configurational microcanonical measure δ(E−H), or rather some regularization thereof, where H is the configu…
RBM and DBM are represented as 2D tensor networks, revealing their expressive power and efficiency.
problem Understanding and optimizing RBM and DBM models.
method Representing RBM and DBM as 2D tensor networks and developing an efficient tensor network contraction algorithm.
result The proposed algorithm for computing partition functions is more accurate than state-of-the-art methods.
We introduce a new method for training deep Boltzmann machines jointly. Prior methods require an initial learning pass that trains the deep Boltzmann machine greedily, one layer at a time, or do not perform well on classifi- cation tasks.
A new method speeds up sampling of Boltzmann distribution in high-dimensional systems.
problem High computational cost of obtaining Jacobian of flow-based models in high dimensions.
method Flow perturbation method that incorporates stochastic perturbations and reweighting.
result Achieves unbiased sampling of Boltzmann distribution with orders of magnitude speedup.
Proposes EM-like method to train Boltzmann machines with unconstrained connectivity.
problem Training Boltzmann machines with complex connectivity.
method Uses Monte Carlo approximation in E-step and approximates M-step gradient in M-step.
result EM-like method can be equivalent to contrastive divergence in restricted Boltzmann machines.
We show that deep narrow Boltzmann machines are universal approximators of probability distributions on the activities of their visible units, provided they have sufficiently many hidden layers, each containing the same number of units as the visible layer. We show that, within certain parameter domains, deep Boltzmann…
Statistical physics tools are applied to reinforcement learning for new dynamic programming approaches.
problem Exploring connections between reinforcement learning and statistical physics.
method Constructing a partition function from trajectories in a Markov decision process and using it to derive a new Bellman equation.
result Policies derived from the partition function are entropy-aware and favor states with multiple outcomes.
A new machine learning model uses score matching to estimate probability densities efficiently.
problem Estimating probability density functions is challenging.
method Introduced a product Jacobi-Theta Boltzmann machine (pJTBM) and used score matching for efficient fitting.
result The pJTBM can fit probability densities more efficiently than the RTBM using score matching.
Restricted Boltzmann Machines (RBM) are a neural network model used in deep learning.
problem Representing probability distributions with hidden variables.
method Mathematical analysis and geometric study of RBM structures.
result Geometry of probability distributions in RBM models.
Neural Boltzmann Machines improve on CRBMs for modeling data.
problem Limited expressivity of CRBMs with noisy data.
method Convert CRBM parameters to neural networks.
result NBMs can approximate data likelihood better.
This paper provides a tutorial on Boltzmann Machines and Deep Belief Networks.
problem Understanding and applying Boltzmann Machines and Deep Belief Networks.
method Explains the structures, conditional distributions, Gibbs sampling, training methods, and deep belief networks of RBMs.
result Comprehensive overview of RBMs and DBNs, useful in various fields.
We review some approaches to the understanding of fluctuations in some models used to describe socio and economic systems. Our approach builds on the development of a simple Langevin equation that characterises stochastic processes. This provides a unifying approach that allows first a straightforward description of th…
New method trains Boltzmann machines without supervision.
problem Training unsupervised learning models.
method Mixed binary quadratic feasibility problem formulation.
result Theory validated on XOR patterns.
CAP-BM learns complex-valued data's amplitude and phase distributions.
problem Learning from complex-valued data with amplitude variation.
method Complex Amplitude-Phase Boltzmann machine (CAP-BM) with Gibbs sampling.
result Necessity of amplitude-amplitude coupling term in CAP-BM.
We propose a relaxation-based approximate inference algorithm that samples near-MAP configurations of a binary pairwise Markov random field. We experiment on MAP inference tasks in several restricted Boltzmann machines. We also use our underlying sampler to estimate the log-partition function of restricted Boltzmann ma…
Reduced hidden units in RBM without performance loss.
problem Maintaining performance with fewer hidden units in RBM.
method Proposed algorithm to decrease hidden units while keeping performance constant.
result Demonstrated through numerical simulations that fewer hidden units can be used without performance degradation.
New method uses Boltzmann machines for compressed sensing of sparse signals without known correlation model.
problem Reconstructing sparse signals from limited measurements without prior correlation knowledge.
method Train a generative Boltzmann machine to infer signal structure, then use message-passing inference for reconstruction.
result Effective reconstruction even with fewer measurements than signal sparsity, as demonstrated on MNIST.
Modified Gibbs-Helmholtz equation geometric models for thermodynamics.
problem Geometric interpretation of Gibbs-Helmholtz equation in thermodynamics.
method Developed new holonomic and non-holonomic geometric models associated to Gibbs-Helmholtz equation.
result Characterized equivalence between Gibbs-Helmholtz entropy and other entropies.