A new method for inferring latent states in Markov jump processes.
problem Intractable exact inference for Markov jump processes.
method Entropic matching within expectation propagation.
result Superior performance in approximating the mean of the posterior process.
CR-UOT improves matching of heterogeneous single-cell omics profiles.
problem Matching nonnegative finite Radon measures across heterogeneous spaces.
method Cost-regularized unbalanced optimal transport (CR-UOT) framework.
result CR-UOT improves alignment of heterogeneous single-cell omics profiles.
Solving linear programs by using entropic penalization has recently attracted new interest in the optimization community, since this strategy forms the basis for the fastest-known algorithms for the optimal transport problem, with many applications in modern large-scale machine learning. Crucial to these applications h…
Unified framework for distribution shift estimation, explanation, and improvement.
problem Estimating, explaining, and improving model performance on target domains with distribution shift.
method Entropic Projection Alignment (EPA) aligns source and target distributions by matching moments and minimizing KL divergence.
result EPA consistently outperforms state-of-the-art baselines while offering computational efficiency.
Unified framework for optimal transport on curved spaces using neural potentials.
problem Optimal transport on curved Riemannian manifolds.
method Entropic RNOT combines entropic regularization with neural pullback parameterization.
result Unified framework recovers entropic optimal coupling in strong probabilistic metrics.
Improved sample complexity for identifying best policies in risk-sensitive reinforcement learning.
problem Identifying approximately optimal policies in risk-sensitive reinforcement learning with exponential horizon dependence.
method Forward-model based algorithm with KL-based exploration bonuses adapted for entropic criterion, leveraging smoothness properties of exponential utility and a new stopping rule.
result Achieved sample complexity matching the lower bound, closing the gap between upper and lower bounds.
New method solves tree-structured Schrödinger Bridge problems.
problem Computing Schrödinger Bridge between tree-structured distributions.
method Iterative Markovian Fitting (IMF) procedure for tree-structured costs.
result Extends IMF to tree-structured Schrödinger Bridge problems.
Introduces entropic tribrackets and their applications in link distinguishing.
problem Distinguishing links with the same counting invariant.
method Definition and study of entropic tribrackets and their homsets.
result Homsets of entropic tribrackets form new entropic tribrackets.
BM2 learns Schrödinger bridges using neural networks.
problem Learning dynamic transport maps between two distributions.
method Coupled Bridge Matching (BM2) with neural networks. result Preliminary theoretical analysis and numerical experiments show BM2's effectiveness. FSBM improves matching efficiency with minimal supervision.
problem Scalability vs. minimal supervision in matching frameworks.
method FSBM uses a small portion of pre-aligned pairs as state feedback to guide non-coupled samples.
result FSBM accelerates training and enhances generalization.
We define link and graph invariants from entropic magmas modeling them on the Kauffman bracket and Tutte polynomial. We define the homology of entropic magmas. We also consider groups that can be assigned to the families of compatible entropic magmas.
The paper analyzes stability and convergence rates of entropic and Sinkhorn potentials.
problem Stability and convergence rates of entropic and Sinkhorn potentials.
method Semiconcavity properties of entropic potentials and Schrödinger bridges.
result Exponential convergence rates for gradient and Hessian of Sinkhorn iterates.
Study of Gaussian distributions using entropic Gromov-Wasserstein and inner product Gromov-Wasserstein.
problem Optimal transportation between Gaussian distributions with different dimensions.
method Entropic Gromov-Wasserstein and inner product Gromov-Wasserstein, with closed-form expressions and von Neumann's trace inequality.
result Closed-form expressions for the entropic IGW and its unbalanced variant between Gaussian distributions.
Improved neural framework for scaling entropic MOT with significant computational gains.
problem High computational overhead in multimarginal optimal transport.
method Neural Entropic MOT (NEMOT) using mini-batch training to reduce complexity.
result Significant speedups and feasibility improvements for multimarginal data.
Entropic herding generates smooth distributions for probabilistic modeling.
problem Generating smooth distributions for probabilistic modeling.
method Derives entropic herding as optimization of maximum entropy principle.
result Entropic herding generates smoother distributions than original herding.
Graph spectra have been successfully used to classify network types, compute the similarity between graphs, and determine the number of communities in a network. For large graphs, where an eigen-decomposition is infeasible, iterative moment matched approximations to the spectra and kernel smoothing are typically used. …
The paper explains emergent phenomena in deep learning using entropic forces.
problem Understanding the cause of emergent phenomena in deep learning and large language models.
method Proposes a rigorous entropic-force theory for neural networks trained with SGD and variants.
result Shows that representation learning is governed by emergent entropic forces that break continuous symmetries and preserve discrete ones.
The paper studies convergence rates of Tsallis entropic regularization in optimal transport.
problem Optimal transport with regularization.
method Γ-convergence and quantization/shadow arguments.
result Derives convergence rate of Tsallis entropic regularization.
Paper generalizes Bakry-Émery calculus for curvature and applies to Markov chains.
problem Formulating both Bakry-Émery and entropic curvature simultaneously.
method Generalization of Bakry-Émery calculus, new measure optimality criterion, dimension parameter in entropic curvature.
result Diameter estimates for Markov chains with strictly positive entropic curvature and spectral gap.
Paper explores entropic curvature in Markov chains, comparing it to other curvatures.
problem Comparing entropic curvature to other curvatures in Markov chains.
method Adapted Γ-calculus for θ-curvatures, explicit lower bounds, curvature perturbation.
result Entropic curvature differs significantly from other curvature notions.
ERTS uses Thompson sampling for Gaussian entropic risk bandits, achieving regret bounds.
problem Risk in decision making complicates reward maximization in MAB problems.
method ERTS (Entropic Risk Thompson Sampling) using Thompson sampling with an entropic risk measure.
result Regret bounds for ERTS under entropic risk measure provided.
An Entropic Dynamics of exchange rates is laid down to model the dynamics of foreign exchange rates, FX, and European Options on FX. The main objective is to represent an alternative framework to model dynamics. Entropic inference is an inductive inference framework equipped with proper tools to handle situations where…
Study entropic regularization of Gaussian measures and processes on Hilbert space.
problem Regularizing 2-Wasserstein distance for infinite-dimensional Gaussian measures and processes.
method Minimum Mutual Information property, closed form formulas, Fréchet differentiability, Sinkhorn barycenter equation.
result Entropic 2-Wasserstein distance and Sinkhorn divergence are Fréchet differentiable in Hilbert space.
Researchers calculated EVaR for various distributions using Lambert function.
problem Difficulty in finding analytical representation of EVaR measure.
method Used Lambert function to calculate EVaR for multiple distributions.
result Successfully calculated EVaR for 7 specific distributions.
Efficiently computes optimal policies for Entropic Risk Measures.
problem Optimizing risk-sensitive metrics in MDPs is computationally expensive.
method Uses Entropic Risk Measures and novel structural analysis for efficient computation.
result Achieves strong performance in various decision-making scenarios.
Efficiently estimates optimal transport maps with rigorous guarantees.
problem Estimating optimal transport maps between distributions efficiently.
method Entropic version of Brenier's theorem, Sinkhorn's algorithm.
result Estimator is parallelizable and efficient for massive data sets.
New risk measures incorporate economic states to assess crude oil derivatives.
problem Assessing risk in crude oil derivatives with varying economic conditions.
method Introduced regime switching entropic risk measures using Markov chains.
result Closed formulae for risk measures derived, showing term structure and mean-reverting convenience yield.
The paper connects tempering and entropic mirror descent for sampling.
problem Sampling from a target distribution with known unnormalized density.
method Establishes the connection between tempering SMC and entropic mirror descent, deriving convergence rates and geometric insights.
result Tempering SMC iterates correspond to entropic mirror descent on the reverse KL divergence, providing new optimization perspectives.
We prove several fundamental statistical bounds for entropic OT with the squared Euclidean cost between subgaussian probability measures in arbitrary dimension. First, through a new sample complexity result we establish the rate of convergence of entropic OT for empirical measures. Our analysis improves exponentially o…
Using elements from the theory of ergodic backward stochastic differential equations (BSDE), we study the behavior of forward entropic risk measures. We provide their general representation results (via both BSDE and convex duality) and examine their behavior for risk positions of long maturities. We show that forward …
The paper improves convergence for linear systems using entropic mirror descent with Polyak stepsizes.
problem Convergence analysis for linear systems with unbounded domain.
method Entropic mirror descent with Polyak stepsizes, sublinear and linear convergence results.
result Generalized convergence result for arbitrary convex functions.
Many information retrieval algorithms rely on the notion of a good distance that allows to efficiently compare objects of different nature. Recently, a new promising metric called Word Mover's Distance was proposed to measure the divergence between text passages. In this paper, we demonstrate that this metric can be ex…
GENOT matches cells across data modalities using neural OT solvers.
problem Scalability, privacy, and out-of-sample estimation issues in traditional OT solvers.
method Learn stochastic maps, parameterize OT maps, relax mass conservation, integrate quadratic solvers.
result Demonstrates significant potential for enhancing therapeutic strategies.
In this paper, we present a new class of Markov decision processes (MDPs), called Tsallis MDPs, with Tsallis entropy maximization, which generalizes existing maximum entropy reinforcement learning (RL). A Tsallis MDP provides a unified framework for the original RL problem and RL with various types of entropy, includin…
New method corrects bias in estimating entropic risk for better decision-making.
problem Underestimation of entropic risk when data are limited.
method Parametric bootstrap procedure to overestimate entropic risk.
result Corrected method provides better risk estimates, leading to improved decision-making.
Energy Matching unifies flow matching and energy-based models for generative modeling.
problem Inability of flow-based models to integrate partial observations and priors.
method Energy Matching framework that integrates flow matching and energy-based models.
result Substantially outperforms existing EBMs on CIFAR-10 and ImageNet generation.
CO2 algorithm creates coresets for generic smooth divergences efficiently.
problem Efficiently creating coresets for generic smooth divergences.
method CO2 algorithm using functional Taylor expansion and maximum mean discrepancy minimization.
result Poly-logarithmically many data points suffice for Sinkhorn divergence approximation.
The study finds a diameter bound for graphs with positive entropic Ricci curvature, with optimal bounds for arithmetic mean.
problem Finding diameter bounds for graphs with positive entropic Ricci curvature.
method Using a localized gradient estimate and an equivalent definition of entropic Ricci curvature, the study derives a Bonnet-Myers type diameter bound.
result The derived diameter bound is optimal for arithmetic mean, but not for logarithmic mean.
QDSB accelerates Schrödinger bridge learning with quantized approximations.
problem Learning generative models from unpaired samples.
method Quantized diffusion Schrödinger bridges (QDSB) using anchor-quantized distributions and cell-wise sampling.
result QDSB achieves sample quality similar to existing methods but with significantly less computational time.
Paper proposes risk-averse reinforcement learning algorithms.
problem Managing model uncertainty in reinforcement learning.
method Entropic risk constrained policy gradient and actor-critic algorithms.
result Demonstrates usefulness of risk-averse algorithms on various domains.
Simplified explanation of ML for mixtures and OT.
problem Maximum likelihood estimation for mixture models.
method Optimal transport with entropic regularization.
result EM algorithm is a block-coordinate descent on OT loss.
Novel algorithms for entropic optimal transport from an optimisation perspective.
problem Solving the entropic-regularised optimal transport problem.
method Developed novel methods inspired by mirror descent, solving semi-dual problems or non-convex constrained problems over joint distributions.
result Non-asymptotic rates of convergence for the proposed methods under minimal assumptions.
The paper sets limits for sequential prediction and recursive algorithms using entropy analysis.
problem Fundamental limitations in sequential prediction and recursive algorithms.
method Entropic analysis to investigate underlying relationships of data and noises.
result Derives Lp bounds quantifiable in conditional entropy. Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.
problem Neural networks' optimization dynamics are confined to a single basin despite connected basins in the loss landscape.
method Identifying entropic barriers arising from the interplay between curvature variations along low-loss paths and noise in optimization dynamics.
result Curvature-induced entropic forces bias noisy dynamics back toward the endpoints, explaining the confinement and connectivity of solutions.
This paper shows how to estimate distances in latent space of random graphs using entropic OT.
problem Estimating distances between groups of nodes in latent space of random graphs.
method Entropic Optimal Transport (OT) with stability results for perturbations of the cost matrix.
result Consistent estimation of entropic OT distances between groups of nodes in latent space.
LOT improves optimal transport for large datasets.
problem Efficient optimal transport for large datasets.
method Low-rank optimal transport (LOT) restricts search to low-nonnegative rank couplings.
result LOT complements and improves upon entropic regularization.
The paper mentioned in the title introduces the entropic value at risk. I give some extra comments and using the general theory make a relation with some commonotone risk measures.
Intertwining curvature bounds for graphs and quantum Markov semigroups verified.
problem Intertwining curvature bounds for graphs and quantum Markov semigroups.
method Introducing and verifying curvature bounds in various examples.
result Improved entropic curvature bounds for depolarizing semigroups and qubits.