A new GAN loss function based on cumulant generating functions improves stability and robustness.
problem Improving the stability and performance of GANs.
method Cumulant GAN loss function based on variational R{é}nyi divergence.
result Cumulant GAN achieves linear convergence to Nash equilibrium and superior performance in image generation.
This paper introduces a variational approximation framework using direct optimization of what is known as the {\it scale invariant Alpha-Beta divergence} (sAB divergence). This new objective encompasses most variational objectives that use the Kullback-Leibler, the R{é}nyi or the gamma divergences. It also gives access…
Study of limits of Einstein-Bogomol'nyi metrics on P^1 in two regimes.
problem Understanding limits of Einstein-Bogomol'nyi metrics on P^1.
method Analysis of two regimes: dissolving limit and large volume limit.
result Recovery of Einstein-Bogomol'nyi metrics on C with total string number N' for each N'.
In this paper we construct new solutions of the Kahler-Yang-Mills equations, by applying dimensional reduction methods to the product of the complex projective line with a compact Riemann surface. The resulting equations, that we call gravitating vortex equations, describe Abelian vortices on the Riemann surface with b…
In this work we consider the gravitating vortex equations. These equations couple a metric over a compact Riemann surface with a hermitian metric over a holomorphic line bundle equipped with a fixed global section --- the Higgs field ---, and have a symplectic interpretation as moment-map equations. As a particular cas…
We obtain all possible solutions of a 1/4 Bogomol'nyi-Prasad-Sommerfield equation exactly, containing configurations made of walls, vortices and monopoles in the Higgs phase. We use supersymmetric U(N_C) gauge theories with eight supercharges with N_F fundamental hypermultiplets in the strong coupling limit. The moduli…
Existence and uniqueness of gravitating vortices on Riemann surfaces with specific properties.
problem Existence and uniqueness of gravitating vortices on compact Riemann surfaces.
method Existence via solving a continuity path, proving existence of singular gravitating vortices, and establishing existence of singular Einstein-Bogomol'nyi equations.
result Existence and uniqueness of gravitating vortices on Riemann surfaces with suitable properties.
The paper finds shape modes for vortices in a specific sigma model.
problem Existence of internal modes in CP1 vortices. method Developed a geometric formalism based on the Bogomol'nyi decomposition of the energy functional.
result Proved the existence of at least one shape mode for a general CP1 vortex solution. Solves existence of gravitating vortices with positive curvature.
problem Existence of gravitating vortices with non-negative topological constant.
method Continuity method, GIT stability condition, Cheeger-Gromov theory.
result Complete solution to existence problem for gravitating vortices with positive curvature.
We consider a general 4n-dimensional quaternionic Kahler geometry with a free action of the torus T^(n+1). The toric action lifts onto the Swann bundle of the quaternionic Kahler space to a tri-holomorphic action that commutes with the standard H* action on the bundle. By matching Pedersen and Poon's generalized Gibbon…
We present a systematic method to construct exactly all Bogomol'nyi-Prasad-Sommerfield (BPS) multi-wall solutions in supersymmetric (SUSY) U(N_C) gauge theories in five dimensions with N_F hypermultiplets in the fundamental representation for infinite gauge coupling. The moduli space of these non-Abelian walls is found…
A gas of N Bogomol'nyi vortices in the Abelian Higgs model is studied on a compact Riemann surface of genus g and area A. The volume of the moduli space is computed and found to depend on N,g and A, but not on other details of the shape of the surface. The volume is then used to find the thermodynamic partit…
Gradient descent converges with arbitrary stepsize for separable data under Fenchel-Young losses.
problem Understanding the conditions under which gradient descent converges with arbitrary stepsize.
method Using Fenchel-Young losses and leveraging the classical perceptron argument to derive convergence rates.
result GD converges with arbitrary stepsize for a majority of Fenchel-Young losses, with better rates for specific loss functions.
The Bogomol'nyi-Prasad-Sommerfield (BPS) multi-wall solutions are constructed in supersymmetric U(N_C) gauge theories in five dimensions with N_F(>N_C) hypermultiplets in the fundamental representation. Exact solutions are obtained with full generic moduli for infinite gauge coupling and with partial moduli for finite …
Paper introduces Lambda EVaR, a new risk measure.
problem Risk management, especially in finance.
method Lambda extension of Rényi entropic value-at-risk (Λ-EVaR). Defines properties and provides axiomatic characterization.
result Λ-EVaR bridges adaptive risk tolerance and moment-sensitive risk assessment.
New divergences extend Bregman and skew Jensen, including f-divergences.
problem Developing new divergences to include f-divergences.
method Introducing g-Bregman and skew g-Jensen divergences, showing they include f-divergences.
result g-divergences generalize existing divergences and inequalities.
Paper shows how to break down a specific type of divergence into simpler parts.
problem Understanding and simplifying divergence functions.
method Decomposes the symmetric Bregman divergence into two types of Jensen divergences and a Bregman divergence, and extends this to include f-divergences.
result Sum decomposition of divergence into simpler parts is possible.
The most fruitful approach to studying low energy soliton dynamics in field theories of Bogomol'nyi type is the geodesic approximation of Manton. In the case of vortices and monopoles, Stuart has obtained rigorous estimates of the errors in this approximation, and hence proved that it is valid in the low speed regime. …
Study explores relationship between Hölder and FDPD divergences.
problem Understanding the relationship between Hölder and FDPD divergences.
method Intersection and generalization of divergence families, proving nonnegativity, deriving inequalities.
result Established ξ-Hölder divergence and derived inequalities. Unified representation of density-power-based divergences simplifies estimation to M-estimation.
problem Outliers in density estimation.
method Define a norm-based Bregman density power divergence (NB-DPD) that reduces to M-estimation.
result NB-DPD connects and generalizes existing divergences, highlighting robustness properties.
This paper improves active learning by using robust divergences for committee disagreement.
problem Active learning with high measurement costs.
method Query by committee with Bregman divergence (including Kullback-Leibler divergence as a special case).
result The proposed method is more robust and performs as well as or better than conventional methods.
New divergence measures improve KL approximation.
problem Improving KL divergence approximation without AC condition.
method Introduced α-geodesical skew divergence. result Properties of α-geodesical skew divergence studied. Logarithmic divergences linked to curvature in statistical manifolds.
problem Understanding the geometric interpretation of curvature in statistical manifolds.
method Analyzing logarithmic L(α)-divergence and its equivalence to conformal transformations and Kurose's geometric divergence. result Logarithmic divergence is a canonical divergence of a statistical manifold with constant sectional curvature −α. The paper improves semi-supervised learning using f-divergences and α-Rényi divergences.
problem Improving semi-supervised learning with noisy pseudo-labels.
method Inspired by f-divergences and α-Rényi divergences, the paper develops new empirical risk functions and regularization techniques. result The new methods show better performance than traditional self-training methods, especially in noisy pseudo-label scenarios.
New divergences introduced in dually flat spaces with properties.
problem Measuring discrepancy between probability distributions in dually flat spaces.
method Introducing two types of divergences based on affine coordinates and potentials, and deriving relational equations.
result Generalization of the law of cosines and new inequalities between divergences.
f-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler divergence, chi-squared divergence, squared Hellinger distance, total variation distance e…
We introduce a new quasi-isometry invariant, called the divergence spectrum, to study finitely generated groups. We compare the concept of divergence spectrum with the other classical notions of divergence and we examine the divergence spectra of relatively hyperbolic groups. We show the existence of an infinite collec…
Discusses a new divergence function in information geometry.
problem Symmetry properties of divergence functions in information geometry.
method Analyzes a recently introduced canonical divergence function.
result Outlines open problems regarding symmetry properties.
The study defines divergence for multivector fields on infinite-dimensional manifolds.
problem Defining divergence for multivector fields on infinite-dimensional manifolds.
method Definition of divergence consistent with finite-dimensional geometry, properties transferred from finite to infinite dimensions.
result Natural properties of divergence are preserved in infinite dimensions.
Technical report on f-divergences and f-GAN training properties.
problem Understanding and optimizing f-divergences for GAN training.
method Elementary derivation and detailed expressions of f-divergences and their variational lower bounds.
result Informative properties of f-divergences and f-GAN training, including gradient matching and stability improvements.
The paper evaluates biased methods for alpha-divergence minimization.
problem The impact of bias on solutions found for alpha-divergence minimization.
method Empirical evaluation of biased methods for alpha-divergence minimization, focusing on bias effects and dimensionality.
result Solutions are biased towards KL-divergence minimizers and require impractical computation in high dimensions to minimize alpha-divergence.
This work presents a parametrized family of divergences, namely Alpha-Beta Log- Determinant (Log-Det) divergences, between positive definite unitized trace class operators on a Hilbert space. This is a generalization of the Alpha-Beta Log-Determinant divergences between symmetric, positive definite matrices to the infi…
Develops a new divergence framework that combines f-divergences and IPMs.
problem Comparing distributions that are not absolutely continuous.
method Introduces (f,Γ)-divergences as a two-stage mass-redistribution/mass-transport process. result Improves estimation, learning, and uncertainty quantification in GANs for heavy-tailed distributions.
A new divergence measure for distributions with different supports.
problem Divergence not defined for distributions with different supports.
method Define Spread Divergence on modified distributions and maximize discriminatory power.
result Spread Divergence can be used to train generative models.
Study compares statistical properties and power of divergence measures for credit risk monitoring.
problem Detecting distributional shifts in credit risk models.
method Derives statistical properties and chi-square benchmark values for Jensen-Shannon Divergence and Kullback-Leibler Divergence, demonstrating their applicability in credit risk monitoring.
result Jensen-Shannon Divergence and Kullback-Leibler Divergence follow chi-square distributions and reveal practical trade-offs in minimizing false positives vs. detecting changes.
New α-divergence loss function improves neural density ratio estimation.
problem Optimization challenges in existing DRE methods, especially overfitting and high sample requirements.
method Derived α-divergence loss function (α-Div) for neural density ratio estimation. result The α-divergence loss function (α-Div) offers stable and effective optimization for DRE. Paper proposes f-EBM for training deep EBMs using various f-divergences.
problem Training deep EBMs with intractable partition functions.
method Introduces f-EBM framework and optimization algorithm for any f-divergence.
result f-EBM outperforms contrastive divergence and other f-divergences.
Study on geometric Jensen-Shannon divergence for Gaussian measures in Hilbert space.
problem Computing divergence between Gaussian measures in infinite-dimensional Hilbert space.
method Closed form expression and regularization for divergence calculation.
result Closed form expression and regularization for Geometric Jensen-Shannon divergence.
The paper explores how information geometry impacts classical CR inequalities.
problem Deriving and generalizing CR inequalities using information geometry.
method Examining Eguchi's theory and applying Amari-Nagoaka's theory to KL-divergence, and then extending to other divergences.
result Generalized CR inequalities derived from various divergences.
We extend CS divergence to conditional distributions and show its advantages in time series data and sequential decision making.
problem Quantifying the closeness between conditional distributions.
method Developed and estimated a conditional Cauchy-Schwarz divergence using kernel density estimation.
result Conditional CS divergence outperforms previous methods in time series clustering and sequential decision making.
Proposes practical kernel tests for f-divergences with theoretical guarantees.
problem Two-sample testing and machine unlearning evaluation.
method Regularized f-divergence kernel tests, adaptive to hyperparameters. result Different f-divergences highlight localized differences. Rényi divergence is related to Rényi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by Rényi as a measure of information that satisfies almost the same axioms as Kullback-Leibler divergence, and depends on a parameter that is called its or…
New optimal transport divergences derived from scoring functions.
problem Developing new divergences for optimal transport.
method Using scoring functions as cost functions in optimal transport.
result Comonotonic coupling is optimal for many new divergences.
Paper derives a new lower bound for KL-divergence using HCRB.
problem Estimating KL-divergence between distributions.
method Using Hammersley-Chapman-Robbins bound and information geometry.
result New lower bound for KL-divergence derived from HCRB.
The paper explores statistical and topological properties of sliced probability divergences.
problem Understanding the topological, statistical, and computational consequences of slicing divergences.
method Deriving theoretical properties of sliced probability divergences, including metric axioms preservation and weak continuity.
result Sliced divergences share similar topological properties and have stable sample complexity.
Classifies divergence and thickness in right-angled Coxeter groups.
problem Characterizing the divergence and thickness of right-angled Coxeter groups.
method Completely classifies divergence functions and proves conditions for thickness using the hypergraph index.
result Exact divergence functions of RACGs can be computed from their defining graphs.
New framework using Jensen-Shannon divergence improves domain adaptation theory.
problem Incoherence between empirical domain adversarial training and theoretical H-divergence. method Established new theoretical framework based on Jensen-Shannon divergence, derived bi-directional upper bounds.
result Framework exhibits flexibilities for various transfer learning problems.
This work extends alpha-beta divergences to complex data and finds closed-form solutions.
problem Approximating complex random vectors.
method Extending alpha-beta divergences to complex data and optimizing the alpha-beta mean distortion.
result Closed-form expression for the centroid of complex random vectors.