arXiv research

Study on relative entropy for hypersurfaces in hyperbolic space.

Extends specific relative entropy to multidimensional continuous martingales.

Entropy asymmetry affects regularization in ERM, leading to biased solutions.

A measure called relative cluster entropy distinguishes between correlated and uncorrelated sequences.

We define a relative entropy for two expanding solutions to mean curvature flow of hypersurfaces, asymptotic to the same cone at infinity. Adapting work of White and using recent results of Bernstein and Bernstein-Wang, we show that expanders with vanishing relative entropy are unique in a generic sense. This also impl…

New statistical test for change-point detection using relative entropy.

Inference for normal and Monte Carlo distributions using minimum relative entropy.

The notion of utility maximising entropy (u-entropy) of a probability density, which was introduced and studied by Slomczynski and Zastawniak (Ann. Prob 32 (2004) 2261-2285, arXiv:math.PR/0410115 v1), is extended in two directions. First, the relative u-entropy of two probability measures in arbitrary probability space…

New regularization method reduces support of empirical risk minimization solutions.

Unique continuation result for expanding Ricci solitons.

We introduce a class of generalized relative entropies (inspired by the Bregman divergence in information theory) on the Wasserstein space over a weighted Riemannian or Finsler manifold. We prove that the convexity of all the entropies in this class is equivalent to the combination of the nonnegative weighted Ricci cur…

We investigate the $m$-relative entropy, which stems from the Bregman divergence, on weighted Riemannian and Finsler manifolds. We prove that the displacement $K$-convexity of the $m$-relative entropy is equivalent to the combination of the nonnegativity of the weighted Ricci curvature and the $K$-convexity of the weig…

Earlier studies have shown that stock market distributions can be well described by distributions derived from Tsallis entropy, which is a generalization of Shannon entropy to non-extensive systems. In this paper, Tsallis relative entropy (TRE), which is the generalization of Kullback-Leibler relative entropy (KLRE) to…

Entropy analysis via kernel methods for probabilistic inference.

A $q$-Gaussian measure is a generalization of a Gaussian measure. This generalization is obtained by replacing the exponential function with the power function of exponent $1/(1-q)$ ($q\neq 1$). The limit case $q=1$ recovers a Gaussian measure. For $1\leq q <3$, the set of all $q$-Gaussian densities over the real line …

Study quantifies information flow in neural networks using relative entropy and RG analogy.

This paper optimizes trading strategies to minimize risk and maximize profit while accounting for market uncertainty.

Two entropy measures quantify suboptimal portfolio performance.

We study a notion of relative entropy motivated by self-expanders of mean curvature flow. In particular, we obtain the existence of this quantity for arbitrary hypersurfaces trapped between two disjoint self-expanders asymptotic to the same cone. This allows us to begin to develop the variational theory for the relativ…

The relative $α$-entropy is the Rényi analog of relative entropy and arises prominently in information-theoretic problems. Recent information geometric investigations on this quantity have enabled the generalization of the Cramér-Rao inequality, which provides a lower bound for the variance of an estimator of an escort…

We introduce a pathwise approach to analyze the relative performance of an equity portfolio with respect to a benchmark market portfolio. In this energy-entropy framework, the relative performance is decomposed into three components: a volatility term, a relative entropy term measuring the distance between the portfoli…

Paper proves Jeffrey's update rule minimizes relative entropy.

A new method, REC, compresses images by encoding their latent representations efficiently.

Abstract: Necessary and sufficient conditions for gradient flows of relative entropy in Lindblad equations.

In this paper we focus on the uniqueness question for (expanding) solutions of the Harmonic map flow coming out of smooth 0-homogeneous maps with values into a closed Riemannian manifold. We introduce a relative entropy for two purposes. On the one hand, we prove the existence of two expanding solutions associated to a…

REMEDI improves neural entropy estimation across various tasks.

The null energy condition is characterized via convexity of entropy in Lorentzian manifolds.

This paper uses normalizing flows to approximate transport maps between densities.

In his 2011 work, Maas has shown that the law of any time-reversible continuous-time Markov chain with finite state space evolves like a gradient flow of the relative entropy with respect to its stationary distribution. In this work we show the converse to the above by showing that if the relative law of a Markov chain…

New surface area measures defined for ball-convex bodies, leading to entropy and inequalities.

We give several Bishop-Gromov relative volume comparisons with integral Ricci curvature which improve the results in \cite{PW1}. Using one of these volume comparisons, we derive an estimate for the volume entropy in terms of integral Ricci curvature which substantially improves an earlier estimate in \cite{Au2} and giv…

The paper extends entropy concepts to Monge-Ampère measures with prescribed singularities.

This paper strengthens the central limit theorem for order statistics using relative entropy.

New measure of maximal entropy found for a class of geometrically finite groups.

Paper develops a robust HVA measure for dynamic hedging under liquidity stress.

Study finds optimal martingale coupling between two distributions with minimal entropy.

Mathematical analysis of SNE and t-SNE for dimension reduction.

Paper finds a new principle for optimizing consumption and wealth using Tsallis entropy.

This work tightens generalization error bounds using Wasserstein distance.

REGS samples from unnormalized distributions using gradient flow and neural networks.

New method uses asymmetric Tsallis relative entropy for better risk assessment in financial portfolios.

Study uses CSIE to estimate portfolio volatility relative to market.

The study optimizes distribution estimation from samples with relative entropy error, adapting to sparse distributions.

Improved sampling from complex distributions with reduced bias.

Study of endperiodic maps on infinite graphs, proving homotopy and eigenvalue properties.

The study proves compactness and existence of entropy minimizers for self-shrinking surfaces.

Econophysics, is based on the premise that some ideas and methods from physics can be applied to economic situations. We intend to show in this paper how a physics concept such as entropy can be applied to an economic problem. In so doing, we demonstrate how information in the form of observable data and moment constra…

Study shows uniform-time chaos propagation in mean field Langevin dynamics.