New framework reveals thermodynamic principles for LLM training.
problem Understanding the training dynamics of large language models.
method Introducing Neural Thermodynamic Laws (NTL) under river-valley loss landscape assumptions.
result Key thermodynamic quantities and principles naturally emerge in LLM training.
Develops a thermodynamics analogy for machine learning objectives.
problem Understanding machine learning objectives.
method Formal correspondence with thermodynamics.
result Implications for machine learning theory.
Study thermodynamic framework for Monge-Ampère equations on real tori.
problem Monge-Ampère equations on real tori.
method Thermodynamic framework, point processes, convergence in law.
result Convergence in law of point processes associated with Monge-Ampère equations.
PA reinterpreted as SB problem, unifying thermodynamics and optimal transport.
problem Optimizing discrete-time paths between probability distributions.
method Schrödinger Bridge theory, solving variational problems.
result PA's reweighting step derived from Schrödinger system.
The paper applies thermodynamics to financial markets to prove no-arbitrage constraints.
problem No arbitrage in financial markets under price impact.
method Stochastic thermodynamics applied to financial trading cycles.
result Proves any round-trip trading strategy yields non-positive expected profit.
This study compares different thermodynamic structure-informed neural networks for solving differential equations.
problem Improving the accuracy and physical consistency of neural network solutions to differential equations.
method Comprehensive evaluation of various thermodynamic formulations in physics-informed neural networks.
result Newtonian-residual-based PINNs fail to reliably recover physical quantities, while structure-preserving formulations enhance accuracy and robustness.
Geometric structures help in understanding thermodynamics.
problem Understanding thermodynamic systems using geometric methods.
method Using almost cosymplectic structures and variational arguments.
result Evolution equations are derived and discussed.
Geometric approach to quantum thermodynamics models state spaces and processes.
problem Quantum thermodynamics in the regime of non-equilibrium states.
method Contact geometry and principal fiber bundles to model quantum state spaces and processes.
result Geometric formulation reveals the fundamental thermodynamic relations and unattainability of the third law.
Geometric study of thermodynamics using cotangent bundles.
problem Formulating classical thermodynamics using geometric structures.
method Contact geometry on cotangent bundles, homogeneous coordinates for intensive variables.
result Geometric formulation of thermodynamics with homogeneity properties.
The paper provides a geometric framework for understanding non-equilibrium thermodynamics.
problem Unclear geometric structure of GENERIC in non-equilibrium thermodynamics.
method Cotangent lifts of dynamics, splitting into holonomic and vertical representatives, and formulation within contact geometry.
result Physical meaning and explicit formulation of the second law of thermodynamics within evolution equations.
Unified framework for understanding TVO and improving model learning.
problem Improving the tightness and efficiency of variational inference bounds.
method Exponential family interpretation and equal spacing in moment parameters.
result Unified framework and improved gradient estimator for TVO.
We introduce thermodynamic response functions for singular Bayesian models.
problem Singular Bayesian models violate regular asymptotics due to non-identifiability and degenerate Fisher geometry.
method Posterior tempering induces thermodynamic response functions, linking WAIC, WBIC, and singular fluctuation.
result WAIC, WBIC, and singular fluctuation are unified within a thermodynamic response framework.
Unified thermodynamic approach to Transformer attention dynamics.
problem Understanding the statistical mechanics of Transformer attention.
method Constructing a Lagrangian on the information manifold to analyze attention dynamics.
result Establishes a formal correspondence between scaled dot-product attention and canonical ensemble statistics.
Model evaluates insurance risk using thermodynamic principles.
problem Risk of lapses due to adverse selection in insurance.
method Collective model with diffusion process influenced by statistical mechanics.
result Derives level premium to evaluate insurance risk.
Proposes a thermodynamic work minimization framework for guiding generative models.
problem Guiding generative models in sparse-data regimes with limited target samples or constraints.
method Regularization framework inspired by thermodynamic work, introducing Path Guidance and Observable Guidance.
result Improves sample efficiency and reduces bias in molecular simulations.
This work develops a machine learning approach to EOS models that accounts for thermodynamic constraints and model uncertainty.
problem Developing accurate equation of state models for high energy-density experiments with inherent uncertainties.
method Physics-informed Gaussian process regression (GPR) framework to capture model uncertainty and thermodynamic constraints.
result The proposed framework reduces prediction uncertainty by incorporating thermodynamic constraints, as demonstrated for diamond carbon EOS.
Introduce a thermodynamically informed, temperature-transferable MLCG framework for proteins.
problem Temperature transferability of MLCG models for proteins.
method Explicit decomposition of CG potential into energetic and entropic components.
result Reproduces temperature-dependent quantities like heat capacity.
The present paper analyses the formal parallelism existing between the laws of thermodynamics and some economic principles. Based on previous works, we shall show how the existence in Economics of principles analogous to those in thermodynamics involves the occurrence of economic events that remind of well-known phenom…
Develops thermodynamic formalism for quasimorphisms on negatively curved spaces.
problem Analyzing quasimorphisms on negatively curved spaces.
method Thermodynamic formalism framework, Banach isomorphism, weak Livšic cohomology.
result Establishes Central Limit Theorem and invariance principle for unbounded quasimorphisms.
New Holder bounds improve variational inference by flattening thermodynamic curves.
problem Improving variational inference by addressing performance gaps between theory and practice.
method Generalizing thermodynamic integration to weighted Holder mean, introducing Holder bounds.
result Holder bounds promise a one-step approximation of exact marginal log-likelihood.
The formal structure of geometrical thermodynamics is reviewed with particular emphasis on the geometry of equilibria submanifolds. On these submanifolds thermodynamic metrics are defined as the Hessian of thermodynamic potentials. Links between geometry and thermodynamics are explored for single and multiple component…
Rate GENERIC extends thermodynamics principles to non-equilibrium systems.
problem Understanding non-equilibrium thermodynamics and its relation to equilibrium thermodynamics.
method Developed a geometrical framework for rate GENERIC, extending Onsager's variational principle.
result Rate GENERIC structure provides a new perspective on thermodynamics in non-equilibrium systems.
The thermodynamics of markets is analyzed, revealing parallels with thermodynamic laws.
problem Understanding economic systems through thermodynamic principles.
method Derivation and analysis of thermodynamic laws applied to economic systems.
result Deep analogy between thermodynamic and economic parameters established.
Financial market risk is modeled using thermodynamics, linking economic quantities to thermodynamic variables.
problem Model risk in financial markets caused by external information sources.
method Established a thermodynamic analogy between financial market variables and economic quantities, linking financial risk to entropy changes.
result Derivation of worst-case risk characterization rules using thermodynamics, leading to equilibrium and non-equilibrium thermodynamic evaluations.
New method learns stochastic thermodynamics from system currents.
problem Understanding entropy production in complex dynamical systems.
method Constructs learning framework using currents and machine learning loss functions.
result Derives loss functions for thermodynamic functions directly from dynamics.
New methods improve neural network training by sampling from target distributions.
problem Optimization procedures like SGD drive parameters to local minima.
method Thermodynamic parameterization using discretized stochastic differential equations.
result Partitioned numerical algorithms converge faster and more robustly.
Study on thermodynamic costs of simple linear regression.
problem Understanding thermodynamic costs in machine learning models.
method Approximated thermodynamic lower bounds for exact and stochastic linear regression.
result Derived scaling laws for optimal dataset size based on generalization error.
The world GDP distribution is described using thermodynamics principles.
problem Understanding the distribution of GDP among countries.
method Applied Rayleigh-Jeans thermalization to GDP data.
result Emergence of low GDP states similar to condensation in optics.
Diffusion models' speed-accuracy relations derived from thermodynamics.
problem Understanding the trade-off between model speed and accuracy.
method Connecting diffusion models to thermodynamics and optimal transport.
result Speed-accuracy relations derived, providing insights into optimal learning protocols.
Geometric structures help in understanding nonequilibrium thermodynamics.
problem Formulating nonequilibrium thermodynamics using geometric objects.
method Using Dirac structures to formulate nonequilibrium thermodynamics.
result Dirac structures provide a consistent extension of mechanics to nonequilibrium thermodynamics.
New method learns transmission matrices from input-output data.
problem Recovering transmission matrices from input-output data in random media.
method Statistical mechanical formulation and pseudolikelihood maximization.
result Inference protocols can learn transmission couplings.
Machine learning generates coarse-grained force fields for molecular dynamics.
problem Creating thermodynamically consistent coarse-grained models for larger systems.
method Hybrid architecture using graph neural networks to learn molecular features.
result Framework reproduces thermodynamics for small biomolecular systems.
Financial market dynamics compared to thermodynamics.
problem Understanding the dynamics of financial markets through thermodynamic principles.
method Analogy with Szilárd information engine to derive market temperature and information extraction.
result Informed traders' gains are bounded by market temperature and information.
Modeling urban transformations, researchers identify phase transitions and thermodynamic efficiency.
problem Urban transformations and their effects on social interactions, transport, and income distribution.
method Developed a statistical-mechanical model of urban transformations, considering fast and slow dynamics.
result Identified phase transitions between dispersed and polycentric urban phases, quantified thermodynamic cost of transformation.
The paper explores how organisms and machines learn from their environment using machine learning, information theory, and thermodynamics.
problem How organisms and machines adapt to their environment.
method Machine learning, information theory, and thermodynamics approaches to understanding and modeling adaptation.
result Unified view of adaptation in organisms and machines based on principles of machine learning, information theory, and thermodynamics.
The author proposes a finance trading strategy named Entropy Oriented Trading and apply thermodynamics on the strategy. The state variables are chosen so that the strategy satisfies the second law of thermodynamics. Using the law, the author proves that the rate of investment (ROI) of the strategy is equal to or more t…
Paper variates Navier-Stokes-Fourier system for thermodynamic consistency.
problem Modeling compressible fluid dynamics with thermodynamic constraints.
method Variational discretization with discrete exterior calculus.
result Derives a nonholonomic variational integrator for NSF system.
The paper connects symplectic geometry tools to statistical mechanics and thermodynamics.
problem Exploring connections between symplectic geometry and statistical mechanics/thermodynamics.
method Presentation of tools from symplectic and Poisson geometry, discussion of Lagrangian and Hamiltonian formalisms, explanation of manifold of motions, and application to statistical mechanics and thermodynamics.
result Generalization of thermodynamic equilibrium concepts using Lie groups.
Derives fluctuation theorems and thermodynamic uncertainty relations for systems modeled as Bayes nets.
problem Entropy production in interacting systems modeled as Bayes nets.
method Derives fluctuation theorems and thermodynamic uncertainty relations for arbitrary sets and conditioned sets of systems in Bayes nets.
result Relates the entropy production of the overall system to the precisions of probability currents in individual systems.
Universal model for soft tissue mechanics under shock waves.
problem Modeling shock wave mechanics in soft biological tissues.
method Continuum mixture theory with phase-field mechanics.
result Universal thermodynamically consistent formulation for soft porous tissues.
We propose a new method of valuation of portfolios and their respective investing strategies. To this end we define a canonical ensemble of portfolios that allows to use the formalism thermodynamics.
Upper bound derived for informed traders' gains in a model, akin to thermodynamics.
problem Informed traders' gains in a financial model with finite horizon.
method Bayesian inference and entropic inequality.
result Upper bound for expected gain, analogous to thermodynamics.
Essay combines thermodynamics, economics, and geobiodynamics to model complex systems.
problem Understanding complex evolutionary systems in economics and geobiodynamics.
method Defines Roegenian Economy, links thermodynamics and economics, analyzes phase equilibrium, and discusses economic black holes.
result Roegenian economic systems are described as Carnot groups with phase equilibrium analysis.
Schrödinger and Onsager's ideas linked in nonequilibrium thermodynamics.
problem Linking Schrödinger's variational problem with Onsager's nonequilibrium statistical mechanics.
method Analyzing the historical context and comparing the two approaches.
result Schrödinger's ideas have not yet been fully integrated into the classical context of Onsager's work.
Physics-informed machine learning models improve biomolecular system simulations.
problem Modeling unresolved interactions beyond classical force fields.
method Physics-informed neural networks and operator learning.
result Accurate, mechanistic, generalizable models for long-timescale kinetics.
Extends likelihood ratio exponential families to analyze various optimization methods.
problem Analyzing optimization methods like rate-distortion and information bottleneck.
method Linking geometric mixture paths to exponential families and using hypothesis testing.
result Provides a common mathematical framework for understanding these methods.
Paper introduces economic Carnot cycles in Roegenian economics.
problem Economic efficiency limits in Roegenian systems.
method Uses Carnot cycle principles to model economic systems.
result Validates economic Carnot cycles in Roegenian economics.
Work maximization guides machine learning models in adaptive systems.
problem How machine learning models can be optimized for thermodynamic efficiency.
method Introducing thermodynamic principle to compare with maximum-likelihood principle.
result Maximum-work models are equivalent to maximum-likelihood models in adaptive systems.