Proposes a new classification model using extended exponential functions.
problem Improving classification accuracy in binary linear classification problems.
method Developed a Bregman-Tweedie classification model based on extended exponential functions.
result The H-Bregman and L-Bregman sub-models outperform traditional methods in ranking and classification accuracy.
This paper re-examines Bregman functions and their divergences, introducing new properties and functions.
problem Exploring properties and applications of Bregman functions and divergences.
method Re-examination of existing Bregman functions and introduction of new ones, providing sufficient conditions for construction.
result Several known Bregman functions are reclassified, and new Bregman functions are introduced.
New Langevin Monte Carlo algorithms for sampling from nonsmooth distributions.
problem Sampling from distributions with nonsmooth convex composite potentials.
method Leveraging Bregman--Moreau envelopes and proximal operators in mirror descent.
result Efficiency in sampling from nonsmooth distributions, extending existing methods.
New geometry for optimal transport cost based on Bregman divergences.
problem Optimal transport cost calculation with Bregman divergences.
method Established properties, defined interpolations, constructed dualistic geometry.
result Derived generalized Pythagorean inequality and Bregman-Wasserstein barycenters.
This manuscript develops the theory of agglomerative clustering with Bregman divergences. Geometric smoothing techniques are developed to deal with degenerate clusters. To allow for cluster models based on exponential families with overcomplete representations, Bregman divergences are developed for nondifferentiable co…
Paper introduces a new method for learning Bregman divergence from data.
problem Suboptimal performance of classic distance metrics in deep metric learning.
method Learning empirical Bregman divergence from data using deep learning.
result Empirical Bregman divergence method outperforms other methods on public datasets.
New Bregman chord divergences simplify distance selection in machine learning.
problem Selecting appropriate distances for machine learning tasks.
method Extend Bregman divergences with two scalar parameters.
result Simplified distance selection with asymptotic generalization of Bregman divergences.
Proposes BMME for optimizing nonsmooth nonconvex problems with block structure.
problem Optimizing nonsmooth nonconvex problems with block structure.
method Block Alternating Bregman Majorization Minimization with Extrapolation (BMME).
result Subsequential convergence to a first-order stationary point under mild assumptions, global convergence under stronger conditions.
The paper develops a method to approximate arbitrary Bregman divergences from supervision.
problem Approximating an arbitrary Bregman divergence from supervision.
method Develops a formulation and algorithm for learning arbitrary Bregman divergences by approximating their convex generating function via a piecewise linear function.
result The method achieves a generalization error of Op(m−1/2) for metric learning, matching known bounds. Unified deep metric learning approach using neural networks.
problem Learning embeddings of data and extending Euclidean distances.
method Deep Bregman divergences based on neural networks.
result Superior performance on benchmark datasets compared to existing methods.
New analysis of annealing paths in sampling and estimation.
problem Sampling from complex distributions and estimating normalization constants.
method Extending known results on Bregman divergence to quasi-arithmetic means under monotonic embedding.
result Analogous result for quasi-arithmetic means, highlighting the interplay between means, parametric families, and divergence functionals.
Optimal payoff choice constrained by Bregman-Wasserstein divergence.
problem Maximizing utility under a deviation constraint from a benchmark.
method Solving the problem using Bregman-Wasserstein divergence with a convex function φ.
result Provided the optimal payoff choice in this setting.
The study evaluates Bregman divergences for learning crowd probabilities.
problem Learning crowd probabilities from global perspectives.
method Adapting machine learning models to target probability distributions using Bregman divergences.
result Special attention is needed when constructing objective functions for neural network optimization.
Paper shows how to break down a specific type of divergence into simpler parts.
problem Understanding and simplifying divergence functions.
method Decomposes the symmetric Bregman divergence into two types of Jensen divergences and a Bregman divergence, and extends this to include f-divergences.
result Sum decomposition of divergence into simpler parts is possible.
Bregman perspective on CART provides a unified framework for impurity measures.
problem Unifying impurity measures in CART
method Bregman divergence approach
result Unified framework for impurity measures
The paper analyzes the bias-variance tradeoff for Bregman divergences.
problem Understanding the bias-variance tradeoff for Bregman divergences.
method Analyzes the bias-variance tradeoff through operations in dual space.
result Derives several results including a generalized law of total variance and ensembling operations.
Paper develops algorithms for nonsmooth, nonconvex statistical learning problems.
problem Nonsmooth and nonconvex objectives in statistical learning.
method Bregman-surrogate algorithm framework, including local linear approximation, mirror descent, iterative thresholding, DC programming.
result Global convergence rates for nonconvex and nonsmooth objectives in high dimensions.
Paper introduces new divergence for robust optimization and machine learning.
problem Improving robust optimization and machine learning performance.
method Derives concentration and asymptotic results using Bregman divergence and proposes Wasserstein-Bregman divergence.
result New divergence (Wasserstein-Bregman) improves performance in robust optimization and machine learning.
Develops a direct debiased machine learning framework using Bregman divergence.
problem Reduces bias in machine learning estimates of causal effects or structural models.
method Neyman targeted estimation and generalized Riesz regression using Bregman divergence.
result Improves estimation of parameters of interest in causal models.
Geometric analysis improves convergence of variational inference.
problem Challenges in analyzing convergence of variational inference due to non-convexity and non-smoothness.
method Exploits exponential family structure and Bregman divergences to geometrically analyze the optimization landscape.
result Establishes non-asymptotic convergence rates for gradient descent algorithms.
Proposes a generative model using scaled-Bregman divergences to handle support mismatch in training.
problem Support mismatch between model and data distributions during training.
method Augments the base measure of the problematic divergence (scaled-Bregman) to resolve the support mismatch problem.
result Demonstrates promising results on MNIST, CelebA, and CIFAR-10 datasets.
Bregman divergences play a central role in the design and analysis of a range of machine learning algorithms. This paper explores the use of Bregman divergences to establish reductions between such algorithms and their analyses. We present a new scaled isodistortion theorem involving Bregman divergences (scaled Bregman…
The paper explores clustering methods using Bregman divergences.
problem Developing efficient clustering algorithms for complex data.
method Investigates fixed rate quantization and Voronoi diagrams in Riemannian metric spaces induced by separable Bregman divergences.
result Experimental results show improved performance of clustering algorithms using these metrics.
New divergences extend Bregman and skew Jensen, including f-divergences.
problem Developing new divergences to include f-divergences.
method Introducing g-Bregman and skew g-Jensen divergences, showing they include f-divergences.
result g-divergences generalize existing divergences and inequalities.
New method estimates model risk without knowing function class.
problem Evaluating model risk for complex, opaque models.
method Wild refitting with Bregman losses and randomized symmetrization.
result Valid upper bound on excess risk for opaque models.
We consider the problem of estimating the inverse covariance matrix by maximizing the likelihood function with a penalty added to encourage the sparsity of the resulting matrix. We propose a new approach based on the split Bregman method to solve the regularized maximum likelihood estimation problem. We show that our m…
BHLR predicts hyperlink weights from data vectors using symmetric similarity functions and Bregman divergence.
problem Predicting hyperlink weights from data vectors in a general framework.
method BHLR learns a symmetric similarity function to minimize Bregman-divergence between hyperlink weights and estimated similarities.
result BHLR is statistically consistent and computationally tractable, providing theoretical guarantees for various methods.
New algorithm solves saddle point problems in Banach spaces.
problem Solving saddle point problems in real reflexive Banach spaces.
method Stochastic Bregman Primal-Dual Splitting Algorithm with relative smoothness and strong convexity assumptions.
result Almost sure convergence to saddle points under various conditions.
This work improves understanding of symmetrizing Bregman divergences on positive definite matrices.
problem Understanding which mean to use for symmetrizing Bregman divergences on positive definite matrices.
method Axiomatic definition of mean functionals and variational principles over the cone of positive definite matrices.
result The arithmetic mean is canonical for forward symmetrization, and the arithmetic, log-Euclidean, and harmonic means for reverse symmetrization.
The paper introduces a new divergence for portfolio management to outperform a benchmark.
problem Maximizing expected utility of outperformance over a benchmark with constraints.
method Uses α-Bregman-Wasserstein divergence to penalize underperformance more than overperformance. result Proves existence and uniqueness of optimal portfolio strategy and conditions for constraints binding.
New methods solve non-Lipschitz smooth problems with guaranteed convergence.
problem Non-Lipschitz smooth problems in machine learning and signal processing.
method Bregman-divergence based algorithms for relatively smooth problems.
result Guaranteed convergence to second-order stationary points for any relatively smooth problem.
In this work, we extend some quantities introduced in "Optimization of conditional value-at-risk" of R.T Rockafellar and S. Uryasev to the case where the proximity between real numbers is measured by using a Bregman divergence. This leads to the definition of the Bregman superquantile. Axioms of a coherent measure of r…
Unified framework for debiased machine learning using Riesz representer and Bregman divergence.
problem Estimating causal and structural parameters in machine learning.
method Generalized Riesz regression for fitting Riesz representer via Bregman divergence minimization.
result Automatic covariate balancing and Neyman orthogonality properties for debiased estimation.
Introduces bi-temperature logistic loss for more robust training.
problem Training neural nets with noise robustness.
method Introduces two temperatures into logistic loss and Bregman divergences.
result Training becomes more robust to noise with bi-temperature loss.
Unified representation of density-power-based divergences simplifies estimation to M-estimation.
problem Outliers in density estimation.
method Define a norm-based Bregman density power divergence (NB-DPD) that reduces to M-estimation.
result NB-DPD connects and generalizes existing divergences, highlighting robustness properties.
New findings show Bregman proximal algorithms can get stuck near non-stationary points.
problem Bregman proximal algorithms can get stuck near non-stationary points, misleadingly suggesting convergence.
method Analysis of Bregman proximal algorithms and their behavior near non-stationary points.
result Bregman proximal algorithms can get stuck near spurious stationary points, even in convex problems.
New algorithm solves maximal monotone inclusion problems.
problem Solving maximal monotone inclusion problems.
method Bregman Douglas-Rachford splitting method and variants.
result Convergence of algorithms under certain assumptions.
New algorithm reduces error in regression problems.
problem Minimizing composite objective functions with quadratic and convex components.
method Stochastic dual averaging with constant step-size, proving convergence rate O(1/n).
result Extends least-squares regression to various convex regularizers and geometries.
This paper introduces a novel approach for learning to rank (LETOR) based on the notion of monotone retargeting. It involves minimizing a divergence between all monotonic increasing transformations of the training scores and a parameterized prediction function. The minimization is both over the transformations as well …
A new model relaxes constraints on exponential dispersion models.
problem Tight conditions on cumulant function limit the class of exponential dispersion models.
method Introduces K-LED model with Legendre cumulant function and Bregman divergence guidance.
result The model allows for easier computation of mean parameter and includes various distributions.
Matrix SMD converges to unique solution minimizing Bregman divergence.
problem High-dimensional multi-output classification and matrix completion problems.
method Stochastic Mirror Descent with matrix parameters and matrix mirror functions.
result Matrix SMD converges exponentially to the unique solution minimizing Bregman divergence.
This paper improves active learning by using robust divergences for committee disagreement.
problem Active learning with high measurement costs.
method Query by committee with Bregman divergence (including Kullback-Leibler divergence as a special case).
result The proposed method is more robust and performs as well as or better than conventional methods.
Unified framework for estimating density ratios in causal inference.
problem Estimating density ratios for causal inference is challenging due to instability and curse of dimensionality.
method Bregman-Riesz regression unifies three methods: Bregman divergences, probabilistic classification, and Riesz loss.
result Unified framework improves density ratio estimation in causal inference.
New method improves structure learning on sparse graphs.
problem Structure learning on sparse directed acyclic graphs (DAGs).
method Bregman proximal gradient method to address non-convex, high-curvature problem.
result Significantly improved convergence and efficiency.
This paper explores a new framework for reinforcement learning based on online convex optimization, in particular mirror descent and related algorithms. Mirror descent can be viewed as an enhanced gradient method, particularly suited to minimization of convex functions in highdimensional spaces. Unlike traditional grad…
Study improves estimation of functions from noisy data using convex penalties.
problem Estimating functions from noisy point evaluations of linear operators.
method Tikhonov regularization with convex and p-homogeneous penalty functionals. result Derives concentration rates for regularized solutions in symmetric Bregman distance.
The paper analyzes insurance contracts under distributional uncertainty using Bregman-Wasserstein divergence.
problem Optimal insurance contracts under distributional ambiguity.
method Utilizes Bregman-Wasserstein ball to characterize ambiguity sets, employs robust optimization.
result Derives optimal indemnity functions in closed form and studies their properties.
A robust clustering method for noisy data using Bregman divergences.
problem Clustering data corrupted with clutter noise.
method k-means type method based on Bregman divergences with a trimming approach.
result Empirically optimal codebook converges to an optimal codebook in the distortion sense.