New divergence defined in Information Geometry mimics Riemannian geodesics.
problem Defining a canonical divergence in Information Geometry.
method Extending Riemannian geodesics to Information Geometry, defining new divergence.
result New divergence recovers dual structures and coincides with existing ones.
Discusses a new divergence function in information geometry.
problem Symmetry properties of divergence functions in information geometry.
method Analyzes a recently introduced canonical divergence function.
result Outlines open problems regarding symmetry properties.
This work improves understanding of symmetrizing Bregman divergences on positive definite matrices.
problem Understanding which mean to use for symmetrizing Bregman divergences on positive definite matrices.
method Axiomatic definition of mean functionals and variational principles over the cone of positive definite matrices.
result The arithmetic mean is canonical for forward symmetrization, and the arithmetic, log-Euclidean, and harmonic means for reverse symmetrization.
New divergences introduced in dually flat spaces with properties.
problem Measuring discrepancy between probability distributions in dually flat spaces.
method Introducing two types of divergences based on affine coordinates and potentials, and deriving relational equations.
result Generalization of the law of cosines and new inequalities between divergences.
We aim to analyze the relation between two random vectors that may potentially have both different number of attributes as well as realizations, and which may even not have a joint distribution. This problem arises in many practical domains, including biology and architecture. Existing techniques assume the vectors to …
Logarithmic divergences linked to curvature in statistical manifolds.
problem Understanding the geometric interpretation of curvature in statistical manifolds.
method Analyzing logarithmic L(α)-divergence and its equivalence to conformal transformations and Kurose's geometric divergence. result Logarithmic divergence is a canonical divergence of a statistical manifold with constant sectional curvature −α. Self-regularizing RBMs learn optimal hidden units efficiently.
problem Learning optimal number of hidden units in RBMs.
method Grand-canonical extension of RBMs with varying hidden units, using chemical potential to control size.
result Efficiently deduces optimal number of hidden units with small generalization error.
Warped product affects divergences in information geometry.
problem Warped product's impact on divergences in information geometry.
method Study of warped product on information geometry.
result Warped product does not preserve canonical divergences.
We prove the logarithmic divergence of equivariant analytic torsion for one-parameter degenerations of projective algebraic manifolds, when the coefficient vector bundle is given by a Nakano semi-positive vector bundle twisted by the relative canonical bundle.
Study local invariants of divergence-free webs in geometry.
problem Characterize triviality of divergence-free webs.
method Introduce two local invariants: differential and geometric.
result Triviality of either invariant characterizes trivial divergence-free web-germs.
We study exponential Levy models with change-point which is a random variable, independent from initial Levy processes. On canonical space with initially enlarged filtration we describe all equivalent martingale measures for change-point model and we give the conditions for the existence of f-divergence minimal equival…
The paper analyzes the error in variational Bayesian NMF compared to Bayesian NMF.
problem Analyzing the variational approximation error in Bayesian NMF.
method Using algebraic geometrical methods, the paper derives an upper bound for the learning coefficient and a lower bound for the approximation error.
result The paper finds a lower bound for the approximation error, showing how well VBNMF approximates Bayesian NMF.
We compute the expected value of the Kullback-Leibler divergence to various fundamental statistical models with respect to canonical priors on the probability simplex. We obtain closed formulas for the expected model approximation errors, depending on the dimension of the models and the cardinalities of their sample sp…
New tensors reveal full curvature structure from Riemann tensor.
problem Limited information from Ricci contraction of Riemann tensor.
method Contracting double dual of Riemann tensor to reveal full curvature.
result New tensors provide canonical parents of Einstein tensor.
Model-free preference under ambiguity defined and applied.
problem Understanding and quantifying ambiguity aversion and prudence.
method Introduces a new model-free definition of ambiguity attitudes and applies it in various contexts.
result New definition of ambiguity prudence equivalent to specific mathematical functions.
Paper solves flat bi-Lagrangian structure problems in ray space.
problem Existence of flat bi-Lagrangian structures in ray space.
method Established geometric conditions for flat canonical connections.
result Complete solutions to two problems regarding flat bi-Lagrangian structures.
Paper resolves bias in ALFT training using generalized alignment games.
problem Systematic bias in estimating logarithmic rewards from small batches.
method Generalized Distributional Alignment Games, U-statistics, minimax polynomial estimators, Variance-Optimal Augmented Polynomial Optimization Program (AQP) Estimator.
result Proves optimal bias and accelerated convergence in ALFT training.
A new GAN model α-GAN with tunable loss function addresses gradient vanishing and mode collapse issues.
problem Addressing vanishing gradients and mode collapse in GANs.
method Introduced a tunable GAN α-GAN using a supervised α-loss function. result Holistic understanding of α-GAN related to Arimoto divergence and convergence properties. A new family of multi-distribution divergences is characterized for fairness and other problems.
problem Comparing more than two probability distributions in a consistent way.
method Characterized a new family of multi-way coincidence divergences.
result The new family of multi-distribution Rényi divergences is necessary and arises from several independent routes.
All you need is log
problem Comparing multiple probability distributions
method Characterizing multi-distribution Rényi divergences
result Found a canonical multi-distribution Rényi calculus
New BMI interface stabilizes user experience over long periods.
problem Inconsistent neural signal data leads to interface recalibration.
method Adversarial Domain Adaptation Network to match residual distributions.
result Adversarial Domain Adaptation Network outperforms other methods.
We study the Asymptotic Cone of Teichmüller space equipped with the Weil-Petersson metric. In particular, we provide a characterization of the canonical finest pieces in the tree-graded structure of the asymptotic cone of Teichmüller space along the same lines as a similar characterization for right angled Artin groups…
A new model relaxes constraints on exponential dispersion models.
problem Tight conditions on cumulant function limit the class of exponential dispersion models.
method Introduces K-LED model with Legendre cumulant function and Bregman divergence guidance.
result The model allows for easier computation of mean parameter and includes various distributions.
Weak harmonic Weyl metrics found on all 4D closed manifolds.
problem Finding canonical metrics on 4D closed manifolds.
method Critical points of a quadratic functional involving the divergence of the Weyl tensor.
result Every 4D closed manifold admits a unique weak harmonic Weyl metric.
We develop a universal distributional calculus for regulated volumes of metrics that are singular along hypersurfaces. When the hypersurface is a conformal infinity we give simple integrated distribution expressions for the divergences and anomaly of the regulated volume functional valid for any choice of regulator. Fo…
Constructs a unique Levi-Civita connection for generalised metrics.
problem Non-uniqueness of generalised Levi-Civita connections.
method Geometrically constructs a canonical generalised Levi-Civita connection.
result Decomposes the generalised Riemann curvature tensor in terms of classical geometric data.
New model for community detection with side information improves recovery accuracy.
problem Community detection in networks with additional node data.
method Data Block Model (DBM) with Chernoff--TV divergence for threshold characterization and efficient algorithm.
result Sharp exact recovery threshold and efficient algorithm for DBM.
The ability of many powerful machine learning algorithms to deal with large data sets without compromise is often hampered by computationally expensive linear algebra tasks, of which calculating the log determinant is a canonical example. In this paper we demonstrate the optimality of Maximum Entropy methods in approxi…
JKO scheme adds deceleration in rapidly changing metric curvature directions.
problem Understanding the implicit bias of the JKO scheme in Wasserstein gradient flow.
method Characterized the implicit bias of the JKO scheme at second order in η, modifying the energy functional.
result JKO scheme adds deceleration in directions where metric curvature of J is rapidly changing.
Bayesian inference improved with classifier-based misspecification detection and tempering.
problem Model misspecification in Bayesian inference leads to overly concentrated posteriors.
method Probabilistic classifiers trained on simulated vs. observed data to estimate model misspecification and tempering level.
result Estimation of negative KL divergence provides useful diagnostic and update method.
Proposes a new phylogenetic tree space with biologically principled geometry.
problem Developing a space for statistical analysis of phylogenies with biologically informed assumptions.
method Introduces wald space, a new phylogenetic tree space, and two related geometries based on Fisher information and Gaussian processes.
result Geodesics in wald space are similar to those in the Fisher information geometry, but the two geometries are distinct.
New divergences extend Bregman and skew Jensen, including f-divergences.
problem Developing new divergences to include f-divergences.
method Introducing g-Bregman and skew g-Jensen divergences, showing they include f-divergences.
result g-divergences generalize existing divergences and inequalities.
The existence of a phase transition with diverging susceptibility in batch Minority Games (MGs) is the mark of informationally efficient regimes and is linked to the specifics of the agents' learning rules. Here we study how the standard scenario is affected in a mixed population game in which agents with the `optimal'…
New method identifies shared components from unpaired multimodal mixtures.
problem Identify shared components from unpaired multimodal mixtures.
method Distribution divergence minimization-based loss with sufficient conditions for identifiability.
result Sufficient conditions for shared component identifiability from unaligned multimodal mixtures.
Paper shows how to break down a specific type of divergence into simpler parts.
problem Understanding and simplifying divergence functions.
method Decomposes the symmetric Bregman divergence into two types of Jensen divergences and a Bregman divergence, and extends this to include f-divergences.
result Sum decomposition of divergence into simpler parts is possible.
Study shows nonextendibility of warped spacelike singularities in specific spacetimes.
problem Nonextendibility of warped spacelike singularities in specific spacetimes.
method Establishes a local obstruction through integrability conditions and radial compression.
result Imply C0-inextendibility for the one-horizon Birmingham-Kottler family. DSM on manifolds removes singularities and computes small-noise expansions.
problem DSM on manifolds with singular noise.
method Rao-Blackwellized score matching, nearest-point projection, intrinsic Riemannian score.
result Canonical target equals intrinsic Riemannian score up to a small correction.
Study explores relationship between Hölder and FDPD divergences.
problem Understanding the relationship between Hölder and FDPD divergences.
method Intersection and generalization of divergence families, proving nonnegativity, deriving inequalities.
result Established ξ-Hölder divergence and derived inequalities. Unified representation of density-power-based divergences simplifies estimation to M-estimation.
problem Outliers in density estimation.
method Define a norm-based Bregman density power divergence (NB-DPD) that reduces to M-estimation.
result NB-DPD connects and generalizes existing divergences, highlighting robustness properties.
This paper improves active learning by using robust divergences for committee disagreement.
problem Active learning with high measurement costs.
method Query by committee with Bregman divergence (including Kullback-Leibler divergence as a special case).
result The proposed method is more robust and performs as well as or better than conventional methods.
New bound matches exact generalization error for quadratic Gaussian problem.
problem Understanding generalization error in quadratic Gaussian problems.
method Information-theoretic approach with new ingredients.
result Exact tight bound for generalization error.
We build a model using Gaussian processes to infer a spatio-temporal vector field from observed agent trajectories. Significant landmarks or influence points in agent surroundings are jointly derived through vector calculus operations that indicate presence of sources and sinks. We evaluate these influence points by us…
New divergence measures improve KL approximation.
problem Improving KL divergence approximation without AC condition.
method Introduced α-geodesical skew divergence. result Properties of α-geodesical skew divergence studied. The paper improves semi-supervised learning using f-divergences and α-Rényi divergences.
problem Improving semi-supervised learning with noisy pseudo-labels.
method Inspired by f-divergences and α-Rényi divergences, the paper develops new empirical risk functions and regularization techniques. result The new methods show better performance than traditional self-training methods, especially in noisy pseudo-label scenarios.
f-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler divergence, chi-squared divergence, squared Hellinger distance, total variation distance e…
We introduce a new quasi-isometry invariant, called the divergence spectrum, to study finitely generated groups. We compare the concept of divergence spectrum with the other classical notions of divergence and we examine the divergence spectra of relatively hyperbolic groups. We show the existence of an infinite collec…
The study defines divergence for multivector fields on infinite-dimensional manifolds.
problem Defining divergence for multivector fields on infinite-dimensional manifolds.
method Definition of divergence consistent with finite-dimensional geometry, properties transferred from finite to infinite dimensions.
result Natural properties of divergence are preserved in infinite dimensions.
Technical report on f-divergences and f-GAN training properties.
problem Understanding and optimizing f-divergences for GAN training.
method Elementary derivation and detailed expressions of f-divergences and their variational lower bounds.
result Informative properties of f-divergences and f-GAN training, including gradient matching and stability improvements.