A new GAN loss function based on cumulant generating functions improves stability and robustness.
problem Improving the stability and performance of GANs.
method Cumulant GAN loss function based on variational R{é}nyi divergence.
result Cumulant GAN achieves linear convergence to Nash equilibrium and superior performance in image generation.
This paper introduces a variational approximation framework using direct optimization of what is known as the {\it scale invariant Alpha-Beta divergence} (sAB divergence). This new objective encompasses most variational objectives that use the Kullback-Leibler, the R{é}nyi or the gamma divergences. It also gives access…
Study of limits of Einstein-Bogomol'nyi metrics on P^1 in two regimes.
problem Understanding limits of Einstein-Bogomol'nyi metrics on P^1.
method Analysis of two regimes: dissolving limit and large volume limit.
result Recovery of Einstein-Bogomol'nyi metrics on C with total string number N' for each N'.
In this paper we construct new solutions of the Kahler-Yang-Mills equations, by applying dimensional reduction methods to the product of the complex projective line with a compact Riemann surface. The resulting equations, that we call gravitating vortex equations, describe Abelian vortices on the Riemann surface with b…
In this work we consider the gravitating vortex equations. These equations couple a metric over a compact Riemann surface with a hermitian metric over a holomorphic line bundle equipped with a fixed global section --- the Higgs field ---, and have a symplectic interpretation as moment-map equations. As a particular cas…
We obtain all possible solutions of a 1/4 Bogomol'nyi-Prasad-Sommerfield equation exactly, containing configurations made of walls, vortices and monopoles in the Higgs phase. We use supersymmetric U(N_C) gauge theories with eight supercharges with N_F fundamental hypermultiplets in the strong coupling limit. The moduli…
Existence and uniqueness of gravitating vortices on Riemann surfaces with specific properties.
problem Existence and uniqueness of gravitating vortices on compact Riemann surfaces.
method Existence via solving a continuity path, proving existence of singular gravitating vortices, and establishing existence of singular Einstein-Bogomol'nyi equations.
result Existence and uniqueness of gravitating vortices on Riemann surfaces with suitable properties.
The paper finds shape modes for vortices in a specific sigma model.
problem Existence of internal modes in CP1 vortices. method Developed a geometric formalism based on the Bogomol'nyi decomposition of the energy functional.
result Proved the existence of at least one shape mode for a general CP1 vortex solution. Solves existence of gravitating vortices with positive curvature.
problem Existence of gravitating vortices with non-negative topological constant.
method Continuity method, GIT stability condition, Cheeger-Gromov theory.
result Complete solution to existence problem for gravitating vortices with positive curvature.
We consider a general 4n-dimensional quaternionic Kahler geometry with a free action of the torus T^(n+1). The toric action lifts onto the Swann bundle of the quaternionic Kahler space to a tri-holomorphic action that commutes with the standard H* action on the bundle. By matching Pedersen and Poon's generalized Gibbon…
We present a systematic method to construct exactly all Bogomol'nyi-Prasad-Sommerfield (BPS) multi-wall solutions in supersymmetric (SUSY) U(N_C) gauge theories in five dimensions with N_F hypermultiplets in the fundamental representation for infinite gauge coupling. The moduli space of these non-Abelian walls is found…
A gas of N Bogomol'nyi vortices in the Abelian Higgs model is studied on a compact Riemann surface of genus g and area A. The volume of the moduli space is computed and found to depend on N,g and A, but not on other details of the shape of the surface. The volume is then used to find the thermodynamic partit…
Gradient descent converges with arbitrary stepsize for separable data under Fenchel-Young losses.
problem Understanding the conditions under which gradient descent converges with arbitrary stepsize.
method Using Fenchel-Young losses and leveraging the classical perceptron argument to derive convergence rates.
result GD converges with arbitrary stepsize for a majority of Fenchel-Young losses, with better rates for specific loss functions.
The Bogomol'nyi-Prasad-Sommerfield (BPS) multi-wall solutions are constructed in supersymmetric U(N_C) gauge theories in five dimensions with N_F(>N_C) hypermultiplets in the fundamental representation. Exact solutions are obtained with full generic moduli for infinite gauge coupling and with partial moduli for finite …
Paper introduces Lambda EVaR, a new risk measure.
problem Risk management, especially in finance.
method Lambda extension of Rényi entropic value-at-risk (Λ-EVaR). Defines properties and provides axiomatic characterization.
result Λ-EVaR bridges adaptive risk tolerance and moment-sensitive risk assessment.
In this paper, we introduce new classes of divergences by extending the definitions of the Bregman divergence and the skew Jensen divergence. These new divergence classes (g-Bregman divergence and skew g-Jensen divergence) satisfy some properties similar to the Bregman or skew Jensen divergence. We show these g-diverge…
Divergence functions play a key role as to measure the discrepancy between two points in the field of machine learning, statistics and signal processing. Well-known divergences are the Bregman divergences, the Jensen divergences and the f-divergences. In this paper, we show that the symmetric Bregman divergence can be …
The most fruitful approach to studying low energy soliton dynamics in field theories of Bogomol'nyi type is the geodesic approximation of Manton. In the case of vortices and monopoles, Stuart has obtained rigorous estimates of the errors in this approximation, and hence proved that it is valid in the low speed regime. …
Study explores relationship between Hölder and FDPD divergences.
problem Understanding the relationship between Hölder and FDPD divergences.
method Intersection and generalization of divergence families, proving nonnegativity, deriving inequalities.
result Established ξ-Hölder divergence and derived inequalities. Unified representation of density-power-based divergences simplifies estimation to M-estimation.
problem Outliers in density estimation.
method Define a norm-based Bregman density power divergence (NB-DPD) that reduces to M-estimation.
result NB-DPD connects and generalizes existing divergences, highlighting robustness properties.
This paper improves active learning by using robust divergences for committee disagreement.
problem Active learning with high measurement costs.
method Query by committee with Bregman divergence (including Kullback-Leibler divergence as a special case).
result The proposed method is more robust and performs as well as or better than conventional methods.
New divergence measures improve KL approximation.
problem Improving KL divergence approximation without AC condition.
method Introduced α-geodesical skew divergence. result Properties of α-geodesical skew divergence studied. The paper improves semi-supervised learning using f-divergences and α-Rényi divergences.
problem Improving semi-supervised learning with noisy pseudo-labels.
method Inspired by f-divergences and α-Rényi divergences, the paper develops new empirical risk functions and regularization techniques. result The new methods show better performance than traditional self-training methods, especially in noisy pseudo-label scenarios.
f-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler divergence, chi-squared divergence, squared Hellinger distance, total variation distance e…
We introduce a new quasi-isometry invariant, called the divergence spectrum, to study finitely generated groups. We compare the concept of divergence spectrum with the other classical notions of divergence and we examine the divergence spectra of relatively hyperbolic groups. We show the existence of an infinite collec…
We study the logarithmic L(α)-divergence which extrapolates the Bregman divergence and corresponds to solutions to novel optimal transport problems. We show that this logarithmic divergence is equivalent to a conformal transformation of the Bregman divergence, and, via an explicit affine immersion, is equivalent t…
The study defines divergence for multivector fields on infinite-dimensional manifolds.
problem Defining divergence for multivector fields on infinite-dimensional manifolds.
method Definition of divergence consistent with finite-dimensional geometry, properties transferred from finite to infinite dimensions.
result Natural properties of divergence are preserved in infinite dimensions.
Technical report on f-divergences and f-GAN training properties.
problem Understanding and optimizing f-divergences for GAN training.
method Elementary derivation and detailed expressions of f-divergences and their variational lower bounds.
result Informative properties of f-divergences and f-GAN training, including gradient matching and stability improvements.
The paper evaluates biased methods for alpha-divergence minimization.
problem The impact of bias on solutions found for alpha-divergence minimization.
method Empirical evaluation of biased methods for alpha-divergence minimization, focusing on bias effects and dimensionality.
result Solutions are biased towards KL-divergence minimizers and require impractical computation in high dimensions to minimize alpha-divergence.
This work presents a parametrized family of divergences, namely Alpha-Beta Log- Determinant (Log-Det) divergences, between positive definite unitized trace class operators on a Hilbert space. This is a generalization of the Alpha-Beta Log-Determinant divergences between symmetric, positive definite matrices to the infi…
Develops a new divergence framework that combines f-divergences and IPMs.
problem Comparing distributions that are not absolutely continuous.
method Introduces (f,Γ)-divergences as a two-stage mass-redistribution/mass-transport process. result Improves estimation, learning, and uncertainty quantification in GANs for heavy-tailed distributions.
Study compares statistical properties and power of divergence measures for credit risk monitoring.
problem Detecting distributional shifts in credit risk models.
method Derives statistical properties and chi-square benchmark values for Jensen-Shannon Divergence and Kullback-Leibler Divergence, demonstrating their applicability in credit risk monitoring.
result Jensen-Shannon Divergence and Kullback-Leibler Divergence follow chi-square distributions and reveal practical trade-offs in minimizing false positives vs. detecting changes.
New α-divergence loss function improves neural density ratio estimation.
problem Optimization challenges in existing DRE methods, especially overfitting and high sample requirements.
method Derived α-divergence loss function (α-Div) for neural density ratio estimation. result The α-divergence loss function (α-Div) offers stable and effective optimization for DRE. Paper proposes f-EBM for training deep EBMs using various f-divergences.
problem Training deep EBMs with intractable partition functions.
method Introduces f-EBM framework and optimization algorithm for any f-divergence.
result f-EBM outperforms contrastive divergence and other f-divergences.
Study on geometric Jensen-Shannon divergence for Gaussian measures in Hilbert space.
problem Computing divergence between Gaussian measures in infinite-dimensional Hilbert space.
method Closed form expression and regularization for divergence calculation.
result Closed form expression and regularization for Geometric Jensen-Shannon divergence.
The paper explores how information geometry impacts classical CR inequalities.
problem Deriving and generalizing CR inequalities using information geometry.
method Examining Eguchi's theory and applying Amari-Nagoaka's theory to KL-divergence, and then extending to other divergences.
result Generalized CR inequalities derived from various divergences.
We extend CS divergence to conditional distributions and show its advantages in time series data and sequential decision making.
problem Quantifying the closeness between conditional distributions.
method Developed and estimated a conditional Cauchy-Schwarz divergence using kernel density estimation.
result Conditional CS divergence outperforms previous methods in time series clustering and sequential decision making.
Proposes practical kernel tests for f-divergences with theoretical guarantees.
problem Two-sample testing and machine unlearning evaluation.
method Regularized f-divergence kernel tests, adaptive to hyperparameters. result Different f-divergences highlight localized differences. Rényi divergence is related to Rényi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by Rényi as a measure of information that satisfies almost the same axioms as Kullback-Leibler divergence, and depends on a parameter that is called its or…
New optimal transport divergences derived from scoring functions.
problem Developing new divergences for optimal transport.
method Using scoring functions as cost functions in optimal transport.
result Comonotonic coupling is optimal for many new divergences.
Classifies divergence and thickness in right-angled Coxeter groups.
problem Characterizing the divergence and thickness of right-angled Coxeter groups.
method Completely classifies divergence functions and proves conditions for thickness using the hypergraph index.
result Exact divergence functions of RACGs can be computed from their defining graphs.
The paper explores statistical and topological properties of sliced probability divergences.
problem Understanding the topological, statistical, and computational consequences of slicing divergences.
method Deriving theoretical properties of sliced probability divergences, including metric axioms preservation and weak continuity.
result Sliced divergences share similar topological properties and have stable sample complexity.
New framework using Jensen-Shannon divergence improves domain adaptation theory.
problem Incoherence between empirical domain adversarial training and theoretical H-divergence. method Established new theoretical framework based on Jensen-Shannon divergence, derived bi-directional upper bounds.
result Framework exhibits flexibilities for various transfer learning problems.
This work extends alpha-beta divergences to complex data and finds closed-form solutions.
problem Approximating complex random vectors.
method Extending alpha-beta divergences to complex data and optimizing the alpha-beta mean distortion.
result Closed-form expression for the centroid of complex random vectors.
Study random walks on groups with superlinear divergent geodesics.
problem Existence of superlinear divergent geodesics in groups.
method Developed theory of superlinear divergence and applied Gouëzel's pivoting technique.
result Established a central limit theorem for random walks on groups with superlinear divergent geodesics.
Regularizes f-divergences with MMD to analyze Wasserstein flows.
problem Limitations of f-divergences in measures' support. method Rewriting MMD regularization as Moreau envelope in RKHS, analyzing gradients.
result Analysis of Wasserstein flows of MMD-regularized f-divergences. We describe the underlying probabilistic interpretation of alpha and beta divergences. We first show that beta divergences are inherently tied to Tweedie distributions, a particular type of exponential family, known as exponential dispersion models. Starting from the variance function of a Tweedie model, we outline how…
The paper introduces a new risk assessment framework using φ-divergence.
problem Assessing risk and decision-making in uncertain conditions.
method Introduces a novel framework called the φ-Divergence Quadrangle.
result Provides a more nuanced understanding of risk through φ-divergence.