Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

166332498664 · Jun 202019922001200920172026
48 results for Continuous Structural Entropy

The space of convex projective structures has been well studied with respect to the topological entropy. But, to better understand the geometry of the structure, we study the entropy of the Sinai-Ruelle-Bowen measure and show that it is a continuous function.

2017-08-29abs ↗pdf ↗

New methods for inferring, predicting, and estimating continuous-time, discrete-event processes.

problem Inferring, predicting, and estimating entropy rate of continuous-time, discrete-event processes.
method Bayesian structural inference extended with neural networks.
result Methods are competitive for prediction and entropy-rate estimation with state-of-the-art.

Extends specific relative entropy to multidimensional continuous martingales.

problem Mutual singularity of martingale laws in continuous time.
method Extension of specific relative entropy from one to multiple dimensions, including closed-form expressions for simple examples.
result Establishes that the lower bound on specific relative entropy from Gantert carries over to higher dimensions and is tight.

Study optimal investment strategies with entropy regularization in volatile markets.

problem Optimal portfolio selection under stochastic volatility with constraints.
method Entropy-regularized relaxed controls, dynamic programming, nonlinear PDEs.
result Existence of classical solutions to nonlinear HJB equation for value function.

Study Transformer layers under cross-entropy training using mean field control.

problem Understanding the behavior of Transformer layers in cross-entropy training.
method Continuous-depth mean field control analysis, treating depth as time and layer parameters as controls.
result Derivation of a Pontryagin condition for the limiting population problem, involving the softmax residual.

We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us to differentiate the output of CEM with respect to the objective function's parameters. In the machine learning setting this brings CEM insi…

2019-09-27abs ↗pdf ↗

Geodesic flows on compact manifolds without conjugate points are shown to have a unique measure of maximal entropy.

problem Analyzing geodesic flows on compact manifolds without conjugate points and with visibility universal covering.
method Using topological mixing, local product structure, and properties of geodesic flows, the authors prove the existence of an expansive factor and uniqueness of measure of maximal entropy.
result The geodesic flow on compact manifolds without conjugate points has a unique measure of maximal entropy.

New entropy flow method extends generalization bounds for all Markov algorithms.

problem Understanding generalization error for Markov algorithms.
method Unified framework using continuous-time approximation and modified logarithmic Sobolev inequalities.
result Established new connections between generalization error and ergodic properties of Markov processes.

Entropy regularization improves policy optimization in reinforcement learning.

problem Improving policy optimization in reinforcement learning.
method Entropy regularization is introduced to soften the greedy policy towards a more diverse softmax policy, leading to a continuously parameterized algorithm that interpolates between policy gradient and Q-learning.
result An intermediate algorithm can improve performance in reinforcement learning.

This work optimizes RL algorithms using entropy regularisation for continuous-time LQ problems.

problem Designing RL algorithms to balance exploration and exploitation in noisy environments.
method Entropy regularisation in two formulations: exploratory control and proximal policy update.
result Regret of O(N)\mathcal{O}(\sqrt{N}) for both learning algorithms over NN episodes.

Insider trading is reduced when penalized, affecting expected penalties in a non-monotone way.

problem Reducing insider trading behavior when insiders face legal penalties.
method Characterized via a backward stochastic differential equation (BSDE) with a non-linear operator.
result The insider's expected penalties are non-monotone in the fee structure and determined by relative entropy.

The article examines entropy-information inequalities for continuous-time Markov chains under curvature-dimension conditions.

problem Proving Li-Yau inequalities and modified logarithmic Sobolev inequalities for reversible Markov chains.
method Introducing the CDΥ(κ,F)CD_Υ(κ,F) condition and deriving entropy-information inequalities.
result Derives functional inequalities relating entropy to Fisher information.

Paper proposes a policy-search algorithm to learn entropy-maximizing exploration policies in reward-free environments.

problem Reward-free learning in high-dimensional, continuous-control domains.
method Maximum Entropy POLicy optimization (MEPOL) algorithm that maximizes a non-parametric state entropy estimate.
result MEPOL learns a maximum-entropy exploration policy that facilitates learning various reward-based tasks.

Develops correlation number for specific potentials and Hitchin representations.

problem Analyzing correlation numbers for potentials with entropy gaps and Hitchin representations.
method Defines a correlation number for pairs of cusped Hitchin representations and explores its connection to the Manhattan curve.
result Establishes a connection between the correlation number and the Manhattan curve, revealing rigidity properties.

CPR adds entropy maximization to improve continual learning methods.

problem Catastrophic forgetting in continual learning.
method Classifier-Projection Regularization (CPR) adds an entropy maximization term to existing regularization methods.
result CPR improves accuracy and plasticity in continual learning methods.

Structured entropy improves classification performance on structured targets.

problem Cross-entropy loss fails to account for target variable structure.
method Proposes structured entropy, a generalization of entropy using random partitions.
result Structured cross-entropy loss yields better results on classification problems with known structure.

Geodesic flows on certain surfaces are shown to be semi-conjugate to expansive flows.

problem Understanding geodesic flows on compact surfaces without conjugate points.
method Time-preserving semi-conjugation to a continuous expansive flow.
result Geodesic flows on compact surfaces without conjugate points of genus > 1 have a unique measure of maximal entropy.

We give a notion of entropy for general gemetric structures, which generalizes well-known notions of topological entropy of vector fields and geometric entropy of foliations, and which can also be applied to singular objects, e.g. singular foliations, singular distributions, and Poisson structures. We show some basic p…

2011-09-24abs ↗pdf ↗

Study uses actor-critic method for continuous-time mean-field control with entropy regularisation.

problem Continuous-time mean-field control in reinforcement learning.
method Actor-critic approach with entropy regularisation, value function alternation, and Wasserstein space parametrisation.
result Derives exact parametrisation of actor and critic functions in linear-quadratic mean-field framework.

In the article, we generalize some recent results of Colding and Minicozzi on generic singularities of mean curvature flow to curved ambient spaces. To do so, we make use of a weighted monotonicity formula to derive an "almost monotonicity" for the entropy upon embedding into R\R^\ell. We are also lead to study the co…

2017-06-05abs ↗pdf ↗

This paper improves reinforcement learning policies in a scalable way.

problem Ensuring monotonic policy improvement in entropy-regularized RL.
method Derives an entropy-aware lower bound and proposes a novel RL algorithm.
result Demonstrates effectiveness in continuous-state tasks using a linear function approximator.

New approach to portfolio optimization shows entropy regularization is ineffective.

problem Entropy regularization in mean-variance portfolio optimization under drift uncertainty.
method Combining Bayesian filtering and stochastic policy optimization.
result Entropy regularization does not accelerate learning about unknown drift.

The paper interprets policy-gradient algorithms using continuation theory.

problem Optimizing nonconvex functions in reinforcement learning.
method Formulates policy optimization as optimization by continuation, interprets policy-gradient algorithms as implicitly optimizing deterministic policies.
result Exploration in policy-gradient algorithms is seen as computing a continuation of the return of the policy.

Bayesian Markowitz portfolio problem shows entropy regularization is ineffective.

problem Entropy regularization in Bayesian Markowitz portfolio optimization.
method Combines continuous-time Bayesian filtering with stochastic policy optimization.
result Entropy regularization does not accelerate learning of unknown drift.

Let f:YXf: Y \rightarrow X be a continuous map between a compact real analytic Kähler manifold (Y,g)(Y,g) and a compact complex {hyperbolic manifold} (X,g0)(X,g_0). In this paper we give a lower bound of the diastatic entropy of (Y,g)(Y,g) in terms of the diastatic entropy of (X,g0)(X,g_0) and the degree of ff. When the lower bound i…

2015-05-08abs ↗pdf ↗

Maximum entropy modeling is a flexible and popular framework for formulating statistical models given partial knowledge. In this paper, rather than the traditional method of optimizing over the continuous density directly, we learn a smooth and invertible transformation that maps a simple distribution to the desired ma…

2017-01-12abs ↗pdf ↗

We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative meas…

2015-01-06abs ↗pdf ↗