Bayesian Markowitz portfolio problem shows entropy regularization is ineffective.
problem Entropy regularization in Bayesian Markowitz portfolio optimization.
method Combines continuous-time Bayesian filtering with stochastic policy optimization.
result Entropy regularization does not accelerate learning of unknown drift.
Inspired by the idea of Colding-Minicozzi in [CM1], we define (mean curvature flow) entropy for submanifolds in a general ambient Riemannian manifold. In particular, this entropy is equivalent to area growth of a closed submanifold in a closed ambient manifold with non-negative Ricci curvature. Moreover, this entropy i…
New approach to portfolio optimization shows entropy regularization is ineffective.
problem Entropy regularization in mean-variance portfolio optimization under drift uncertainty.
method Combining Bayesian filtering and stochastic policy optimization.
result Entropy regularization does not accelerate learning about unknown drift.
New method for comparing different mass measures on tree structures using entropy partial transport.
problem Comparing nonnegative measures with different masses on tree structures.
method Entropy Partial Transport (EPT) on extended trees, regularized for fast computation and negative definiteness.
result First closed-form solution for unbalanced OT on tree structures.
New scalable algorithm for non-negative linear regression with entropy-regularized OT loss.
problem Generalizing task-specific linear models to broader applications.
method Sinkhorn-like scaling iterations for convex penalty and datafit terms.
result Simple multiplicative updates for various penalty and datafit terms.
FTRL algorithm with negative entropy regularizer achieves best-of-three-world results for linear bandits.
problem Designing an FTRL algorithm for linear bandits with optimal regret bounds.
method Follow-the-regularized-leader (FTRL) algorithm with negative entropy regularizer.
result Regret bounds achieve the same or nearly the same order as detect-switch type algorithm but with simpler design.
We consider a smooth closed surface M M M of fixed genus ⩾ 2 \geqslant 2 ⩾ 2 with a Riemannian metric g g g of negative curvature with fixed total area. The second author has shown that the topological entropy of geodesic flow for g g g is greater than or equal to the topological entropy for the metric of constant negative curvatu…
News novelty predicts negative stock market returns.
problem Negative stock market returns due to increased news novelty.
method Quantified news novelty using entropy measure from recurrent neural network applied to a large news corpus.
result Entropy exposure carries a negative risk premium, indicating that assets positively correlated with entropy hedge aggregate news risk.
Unified interpretation of softmax cross-entropy and negative sampling for knowledge graph embedding.
problem Lack of theoretical relationship between softmax cross-entropy and negative sampling loss functions in knowledge graph embedding.
method Used Bregman divergence to provide a unified interpretation of the two loss functions.
result Theoretical findings for fair comparison of softmax cross-entropy and negative sampling are derived.
We survey several notions of entropy related to a compact manifold of negative curvature, some relations between them, and the rigidity problems.
Sharp inequality in spaces with non-negative Ricci curvature.
problem Proving a sharp isoperimetric inequality in metric measure spaces.
method Using volume entropy in non-compact metric measure spaces with non-negative synthetic Ricci curvature.
result Proved a sharp dimension-free isoperimetric inequality.
A new approach improves numerical tabular data imputation by addressing diffusion models' limitations.
problem Inaccurate and difficult training in numerical tabular data imputation.
method Kernelized Negative Entropy-regularized Wasserstein gradient flow Imputation (KnewImp) based on Wasserstein gradient flow (WGF) framework.
result KnewImp significantly outperforms existing methods in numerical tabular data imputation.
Sharp isoperimetric inequality on Finsler manifolds with non-negative Ricci curvature.
problem Proving an isoperimetric inequality on Finsler metric measure manifolds.
method Defining volume entropy and second Cheeger constant, proving sharp inequality.
result Sharp isoperimetric inequality involving volume entropy and weighted Ricci curvature.
We demonstrate the irreversibility of a wide class of world-sheet renormalization group (RG) flows to first order in α ′ α' α ′ in string theory. Our techniques draw on the mathematics of Ricci flows, adapted to asymptotically flat target manifolds. In the case of somewhere-negative scalar curvature (of the target space), we…
DAC enhances exploration in reinforcement learning with entropy regularization.
problem Improving exploration efficiency in reinforcement learning.
method Sample-aware entropy regularization using replay buffer action distributions.
result DAC significantly outperforms existing algorithms in reinforcement learning tasks.
Study on entropy stability in product spaces of negatively curved symmetric spaces.
problem Stability of minimal entropy rigidity in product spaces of negatively curved symmetric spaces.
method Analysis of minimal entropy sequences and proof of intrinsic uniqueness of spherical Plateau solutions.
result Entropy-minimizing sequences converge to the model space after removing subsets whose n-volume converges to zero.
The paper connects currents and entropy in hyperbolic 3-manifolds.
problem Understanding the entropy of negatively curved 3-manifolds.
method Intersection of geodesic and conformal currents, proving sharp bounds.
result New proofs of Liouville entropy, minimal surface entropy, and Mostow Rigidity Theorem.
Liouville entropy increases strictly along Ricci flow on surfaces.
problem Understanding the behavior of Liouville entropy under Ricci flow.
method New expression for Liouville entropy derivative, proof of positivity in specific directions.
result Liouville entropy is strictly increasing along normalized Ricci flow for 1/6-pinched metrics.
The paper proves a quantitative rigidity result for spaces with specific curvature bounds.
problem Understanding the rigidity of spaces with almost maximal volume entropy.
method Analyzing Riemannian manifolds and RCD \operatorname{RCD} RCD -spaces with specific curvature conditions. result Spaces with almost maximal volume entropy are closely related to hyperbolic space forms.
The study examines entropy and pressure at infinity in negatively curved manifolds, linking them to strong positive recurrence.
problem Investigating strong positive recurrence in negatively curved manifolds.
method Defining and comparing entropy and pressure at infinity through different measures.
result Strong positive recurrence potentials admit finite Gibbs measures.
Topological entropy decreases strictly along Ricci flow near hyperbolic metrics.
problem Understanding entropy changes in flows near hyperbolic metrics.
method Analysis of geodesic flow on Riemannian manifolds with variable negative curvature.
result Topological entropy strictly decreases along normalized Ricci flow near hyperbolic metrics.
Entropy-regularized NPG converges linearly with linear function approximation.
problem Analyzing convergence of entropy-regularized NPG with function approximation.
method Established finite-time convergence analyses with entropy regularization and linear function approximation.
result Entropy-regularized NPG achieves linear convergence up to a function approximation error.
The entropy of minimal surfaces is minimized in hyperbolic manifolds.
problem Counting essential minimal surfaces in closed negatively curved manifolds.
method Defining minimal surface entropy and computing it for various spaces.
result Minimal surface entropy is minimized in hyperbolic manifolds.
The paper studies optimal transport in linear quadratic systems and derives interpolation inequalities.
problem Optimal transport problem in Linear Quadratic optimal control systems.
method Well-posedness of the Monge problem, regularity of optimal transport map, displacement interpolation of measures.
result Derivation of general interpolation inequalities for entropy functionals.
Entropy asymmetry affects regularization in ERM, leading to biased solutions.
problem Analyzing the impact of relative entropy asymmetry in ERM regularization.
method Examined Type-I and Type-II ERM-RER, comparing their solutions and properties.
result Type-II ERM-RER regularization introduces a strong bias against training data.
Study compares synthetic and distributional Ricci curvature bounds.
problem Comparing synthetic and distributional approaches to lower Ricci curvature bounds.
method Analyzes synthetic via weak displacement convexity and distributional via non-negativity of Ricci-tensor.
result Distributional bounds imply entropy bounds for C 1 C^1 C 1 metrics and vice versa for C 1 , 1 C^{1,1} C 1 , 1 under convergence condition. Entropy regularization improves MFG learning efficiency and stability.
problem Improving Mean Field Game learning efficiency and stability.
method Entropy regularization applied to MFG with learning.
result Entropy regularization yields time-dependent policies and stabilizes convergence.
New method reduces regret for sparse adversarial SSP problems.
problem Sparse adversarial Stochastic Shortest Path problem.
method Proposed ℓ r \ell_r ℓ r -norm regularizers for adaptive sparsity. result Regret scales with log M \sqrt{\log M} log M instead of log S A \sqrt{\log SA} log S A . State entropy regularization improves robustness in reinforcement learning, especially under structured perturbations.
problem Structured and spatially correlated perturbations in reinforcement learning.
method State entropy regularization, compared to policy entropy.
result State entropy regularization provides better robustness to structured and spatially correlated perturbations.
In 2004, Manning showed that the topological entropy of the geodesic flow for a surface of negative curvature decreases as the metric evolves under the normalised Ricci flow. It is an interesting open problem, also due to Manning, to determine to what extent such behaviour persists for higher dimensional manifolds. In …
New regularization method reduces support of empirical risk minimization solutions.
problem Regularization in empirical risk minimization with relative entropy.
method Introduces Type-II regularization, characterizes solutions, analyzes properties of relative entropy.
result Type-II regularization collapses solution support into reference measure's support.
In deep neural network, the cross-entropy loss function is commonly used for classification. Minimizing cross-entropy is equivalent to maximizing likelihood under assumptions of uniform feature and class distributions. It belongs to generative training criteria which does not directly discriminate correct class from co…
Alexandrov spaces with non-negative curvature are characterized by the matrix displacement convexity of an entropy tensor.
problem Characterizing non-negative curvature in Alexandrov spaces
method Constructing a parallel trivialization of the entropy tensor
result The entropy tensor is matrix displacement convex on Alexandrov spaces
Study of entropy-regularized LQG MFGs with exploratory actions.
problem Optimizing multi-population mean field games with entropy regularization.
method Introduced exploratory actions and derived optimal action distributions.
result Optimal action distributions lead to ε-Nash equilibria in finite-population MFGs.
AER dynamically adjusts entropy regularization for better LLM reinforcement learning.
problem Policy entropy collapse in RLVR training limits exploration and reasoning performance.
method Adaptive Entropy Regularization (AER) with difficulty-aware coefficient allocation, initial-anchored target entropy, and dynamic global coefficient adjustment.
result AER consistently outperforms baselines on mathematical reasoning benchmarks, improving both accuracy and exploration.
Quantum machine learning uses quantum cross entropy to minimize loss, but measurement loss affects this process.
problem Quantum machine learning's loss minimization through cross entropy is affected by measurement outcomes.
method Defined quantum cross entropy, proved its lower bounds, and investigated its relation to quantum fidelity and likelihood.
result Quantum cross entropy is lower-bounded by negative log-likelihood when derived from quantum data, but measurement outcomes can cause loss.
We compute the second variation of the Ricci expander entropy and briefly discuss the linear stability of compact negative Einstein manifolds.
This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to Bregman divergences. Our framework thus naturally generalizes a previously proposed …
Entropy regularization improves policy optimization in reinforcement learning.
problem Improving policy optimization in reinforcement learning.
method Entropy regularization is introduced to soften the greedy policy towards a more diverse softmax policy, leading to a continuously parameterized algorithm that interpolates between policy gradient and Q-learning.
result An intermediate algorithm can improve performance in reinforcement learning.
We find obstructions to the existence of Einstein metrics of non-negative sectional curvature on a smooth closed simply connected manifold of any dimension. The results are achieved by combining the classical Morse theory of the loop space with a new upper bound for the topological entropy of the geodesic flow in terms…
Paper introduces robust market making using Wasserstein distance and entropy regularization.
problem Market making robustness under uncertainty.
method Wasserstein distance, entropy regularization, convex optimization, optimal radius selection.
result The robust market making problem can be reformulated as a convex optimization problem.
The Bregman divergence (Bregman distance, Bregman measure of distance) is a certain useful substitute for a distance, obtained from a well-chosen function (the "Bregman function"). Bregman functions and divergences have been extensively investigated during the last decades and have found applications in optimization, o…
Paper develops a new probabilistic method for American options using entropy regularization.
problem Finding optimal stopping times for American options with entropy regularization.
method Entropy-regularized penalization scheme based on Doob-Meyer-Mertens decomposition and reflected backward stochastic differential equations.
result Explicit convergence rates and policy improvement algorithm for American options.
Entropy regularization is used to get improved optimization performance in reinforcement learning tasks. A common form of regularization is to maximize policy entropy to avoid premature convergence and lead to more stochastic policies for exploration through action space. However, this does not ensure exploration in th…
Geodesics in curved spaces spread evenly over time.
problem Equidistribution of geodesics in negatively curved spaces.
method Proving equidistribution of geodesic flow orbits towards measures of maximal entropy and Bowen-Margulis measure.
result Equidistribution of divergent geodesics in negative curvature as their complexity increases.
Entropy-regularized NPG methods converge linearly in discounted MDPs.
problem Theoretical limitations of NPG methods in reinforcement learning.
method Entropy regularization in conjunction with NPG methods for discounted MDPs.
result Entropy-regularized NPG methods converge linearly in discounted MDPs.
Paper connects RL and non-equilibrium statistical mechanics for entropy-regularized RL.
problem Obtaining analytical solutions for entropy-regularized RL.
method Mapping RL to non-equilibrium statistical mechanics, applying large deviation theory.
result Derives exact analytical results for optimal policy and dynamics in MDPs.
HCLM framework uses entropy regularization for open learning systems.
problem Real-world AI challenges and limitations of deep learning.
method Dynamical and information-theoretic framework with entropy regularization.
result Geometric entropy surrogates, especially log-determinant covariance entropy, induce stronger and more stable information forces.