Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

306191121 · May 202619922001200920172026
48 results for logarithmic divergence

We study the logarithmic L(α)L^{(α)}-divergence which extrapolates the Bregman divergence and corresponds to solutions to novel optimal transport problems. We show that this logarithmic divergence is equivalent to a conformal transformation of the Bregman divergence, and, via an explicit affine immersion, is equivalent t…

2019-06-17abs ↗pdf ↗

LMC algorithm converges to target in Chi-squared and Renyi divergence.

problem Sampling from target distribution using LMC with strong dissipativity and smoothness conditions.
method LMC algorithm with strong dissipativity and first-order smoothness, initialized with Gaussian.
result LMC reaches ε-neighborhood of target in Chi-squared and Renyi divergence in O(λ²dε⁻¹) steps.

We introduce a temperature into the exponential function and replace the softmax output layer of neural nets by a high temperature generalization. Similarly, the logarithm in the log loss we use for training is replaced by a low temperature logarithm. By tuning the two temperatures we create loss functions that are non…

2019-06-08abs ↗pdf ↗

The Kelly Criterion is applied to prediction markets to analyze risk and return.

problem Mean beliefs in prediction markets often differ from actual prices.
method Logarithmic utility and Kullback-Leibler divergence are used to study risk and return adjustments.
result Misjudgment of bias and investment fraction affect portfolio growth rate.

This work generalizes calibeating for a broader range of proper losses using Bregman divergence.

problem Calibration for a wide range of proper losses beyond Brier and log loss.
method Regret minimization based on Bregman divergence for a family of proper losses.
result U-calibration results for a family of Tsallis losses with logarithmic regret and dimension independence.

Method identifies low-dimensional structure in high-dimensional probability measures.

problem Identifying low-dimensional structure in high-dimensional probability measures.
method Extends prior work on minimizing majorizations of the Kullback-Leibler divergence to identify optimal approximations within a specific class of measures.
result Connection between dimensional logarithmic Sobolev inequality and approximations with the ansatz.

The study reveals the hierarchical structure of the international FOREX market using currency fluctuation distribution similarities.

problem Understanding the hierarchical structure of the international FOREX market.
method Using Jensen-Shannon divergence to quantify the similarity between normalized logarithmic return distributions of currencies.
result Clusters of currencies are consistent with the nature of underlying economies but diverge during crises.

We prove the logarithmic divergence of equivariant analytic torsion for one-parameter degenerations of projective algebraic manifolds, when the coefficient vector bundle is given by a Nakano semi-positive vector bundle twisted by the relative canonical bundle.

2010-07-16abs ↗pdf ↗

CO2 algorithm creates coresets for generic smooth divergences efficiently.

problem Efficiently creating coresets for generic smooth divergences.
method CO2 algorithm using functional Taylor expansion and maximum mean discrepancy minimization.
result Poly-logarithmically many data points suffice for Sinkhorn divergence approximation.

New bounds close the score matching gap for diffusion models.

problem The difference between sample quality and score matching loss in diffusion models.
method Theoretical analysis of score matching gap, developing tighter bounds for KL divergence, reverse KL divergence, and Wasserstein distance.
result The quality of score approximation impacts closing the score matching gap for low noise scales.

Optimized α\alpha-posteriors reduce KL divergence from true posterior in parametric misspecification.

problem Reduction of KL divergence from true posterior in parametric model misspecification.
method Derivation of Bernstein-von Mises theorem and optimization of α\alpha-posteriors.
result Optimized α\alpha-posteriors minimize KL divergence from true posterior, especially in severe misspecification.

Mathematical study of excess growth rate connects info theory with finance.

problem Understanding the excess growth rate in portfolio theory.
method Axiomatic characterization theorems of excess growth rate in terms of relative entropy, Jensen's inequality gap, and logarithmic divergence.
result Established rich connections between information theory and finance.

The paper explores the geometric structure of cost functions in multiple dimensions.

problem Understanding the geometric properties of cost functions in multidimensional settings.
method Analyzes the Hessian metric and geodesics in logarithmic and original coordinates.
result The geometry is one-dimensional in logarithmic coordinates but effectively (n1)(n-1)-dimensional in original coordinates.

Improved GANs estimate convergence rate for density estimation.

problem Improving the accuracy of density estimation with GANs.
method Proved an oracle inequality for JS divergence between GAN estimate and true density.
result JS-divergence rate of convergence is (logn/n)2β/(2β+d)(\log{n}/n)^{2β/(2β+ d)}.

We study the geometry of probability distributions with respect to a generalized family of Csiszár ff-divergences. A member of this family is the relative αα-entropy which is also a Rényi analog of relative entropy in information theory and known as logarithmic or projective power divergence in statistics. We apply E…

2020-01-14abs ↗pdf ↗

Paper analyzes risk bounds for in-context learning in multiclass classification.

problem Risk bounds for in-context learning in multiclass classification.
method Formalizes tasks as sequences of labeled examples and queries, estimates conditional class probabilities, establishes oracle inequality for KL divergence.
result ICL achieves minimax optimal rate for conditional probability estimation.

New schemes improve error estimates for sampling from non-log-concave distributions.

problem Improving sampling from non-log-concave distributions with super-linear drift growth.
method Developed tamed Euler and randomized Euler schemes with error estimates.
result Near-optimal error bounds for sampling and optimization problems.

Proposes a general method to derive regret bounds for multi-armed bandit algorithms.

problem Deriving regret bounds for randomized multi-armed bandit algorithms.
method Checking sufficient conditions on sampling probabilities and distributions.
result Proves logarithmic regret bounds for various bandit algorithms and new models.

LinMED is a new linear bandit algorithm with near-optimal regret bound.

problem Optimizing decision-making in linear bandit problems with sub-Gaussian distributions.
method LinMED is a randomized linear bandit algorithm with closed-form arm sampling probabilities.
result LinMED achieves a near-optimal regret bound of dnd\sqrt{n} up to logarithmic factors.

WDAIL uses Wasserstein distance for more effective reward shaping in IL.

problem Fixed reward functions in GAIL limit performance on complex tasks.
method Introduces Wasserstein distance and PPO for improved reward shaping and stability.
result Significant performance improvement in complex MuJoCo tasks.

Paper resolves bias in ALFT training using generalized alignment games.

problem Systematic bias in estimating logarithmic rewards from small batches.
method Generalized Distributional Alignment Games, U-statistics, minimax polynomial estimators, Variance-Optimal Augmented Polynomial Optimization Program (AQP) Estimator.
result Proves optimal bias and accelerated convergence in ALFT training.

New bounds found for optimizing non-convex functions with noisy data.

problem Limits of first-order stochastic optimization in non-convex settings.
method Divergence decomposition to construct challenging subclasses.
result Sharp lower bounds on noisy gradient queries for various non-convex classes.

New algorithms achieve logarithmic regret in KL-regularized Markov games.

problem Improving sample efficiency in game-theoretic settings with KL regularization.
method Developed OMG and SOMG algorithms for matrix and Markov games, using best response sampling and superoptimistic bonuses.
result Logarithmic regret in TT that scales inversely with KL regularization strength ββ.

Random Gaussian fields on 4D Riemannian manifolds with conformal invariance.

problem Characterizing and analyzing Gaussian fields on 4D Riemannian manifolds.
method Constructing and analyzing co-biharmonic Gaussian fields with covariance kernels defined by the Paneitz operator.
result Rigorous derivation of quantum Liouville measure for γ<8|γ|<\sqrt8.

We investigate the mm-relative entropy, which stems from the Bregman divergence, on weighted Riemannian and Finsler manifolds. We prove that the displacement KK-convexity of the mm-relative entropy is equivalent to the combination of the nonnegativity of the weighted Ricci curvature and the KK-convexity of the weig…

2010-05-08abs ↗pdf ↗

The paper optimizes distribution estimation with high probability in Kullback-Leibler divergence.

problem Estimating discrete distributions with high probability in Kullback-Leibler divergence.
method Uses online learning techniques for novel estimator construction via online-to-batch conversion.
result Optimal rate of estimation is pinned down up to a doubly logarithmic factor of K.

A method for learning skeleton of Bayesian networks robust to outliers and corruption.

problem Learning the exact skeleton of discrete Bayesian networks from corrupted data.
method Distributionally robust optimization and regression approach, optimizing worst-case risk over distributions within bounded Wasserstein distance or KL divergence.
result Logarithmic sample complexities for successful structure learning of bounded-degree graphs.

In their papers published in 1993 and 1994, by expressing certain physical quantity in two distinct ways, Bershadsky-Cecotti-Ooguri-Vafa discovered a remarkable equivalence between Ray-Singer analytic torsion and elliptic instanton numbers for Calabi-Yau threefolds. After their discovery, in a paper published in 2008, …

2014-08-30abs ↗pdf ↗

We introduce a class of generalized relative entropies (inspired by the Bregman divergence in information theory) on the Wasserstein space over a weighted Riemannian or Finsler manifold. We prove that the convexity of all the entropies in this class is equivalent to the combination of the nonnegative weighted Ricci cur…

2011-12-23abs ↗pdf ↗

The paper tightens bounds for estimating Schrödinger potentials in unpaired data translation.

problem Estimating Schrödinger potentials in unpaired data translation.
method Using stochastic optimal control and Ornstein-Uhlenbeck process, the paper derives tight bounds on the generalization ability of an empirical risk minimizer.
result The approach achieves almost optimal convergence rates for Gaussian mixtures.

Introduces q-paths for generalizing geometric annealing paths in machine learning.

problem Limited applicability of existing path methods in machine learning.
method Develops a family of paths derived from a generalized mean, including geometric and arithmetic mixtures.
result Empirical gains in Bayesian inference and generative model evaluation.

Study scaling of optimal solutions for reliability constraints in resource provisioning.

problem Achieving high reliability in resource provisioning under stringent requirements.
method Chance-constrained optimization, distributionally robust optimization, f-divergence balls, line search.
result Correct scaling properties of optimal decisions are preserved by using appropriate f-divergence balls, leading to conservative yet near-optimal solutions.

Paper optimizes private PCA for covariance estimation in statistics.

problem Private estimation of covariance matrices and principal components.
method Developed differentially private estimators for spiked covariance model.
result Established minimax rates of convergence for principal components and covariance matrix estimation.

Sharp 2-Wasserstein bounds for DDPMs derived from Föllmer process.

problem Sampling error bounds for DDPMs in 2-Wasserstein distance.
method Lipschitz-type conditions on score function, Föllmer process, and log-concave target distributions.
result Sharp upper bounds for DDPMs in 2-Wasserstein distance, optimal in dimension and steps.