This work introduces a new metric for comparing imprecise probability models.
problem Quantifying differences between imprecise probability models.
method Integral imprecise probability metric framework based on Choquet integral.
result IIPM enables comparison across different imprecise probability models and quantifies epistemic uncertainty.
Paper examines stability of Bayesian posterior measures using integral probability metrics.
problem Stability of Bayesian inference in large-scale inverse problems.
method New families of integral probability metrics for likelihood and prior perturbations.
result Constructs new stability results for Bayesian posterior measures.
We study the minimax optimal rates for estimating a range of Integral Probability Metrics (IPMs) between two unknown probability measures, based on n independent samples from them. Curiously, we show that estimating the IPM itself between probability measures, is not significantly easier than estimating the probabili…
A nonparametric two-sample test using a parametric integral probability metric
problem Detecting distributional differences between two independent samples
method Propose a new two-sample test statistic based on a newly introduced integral probability metric (IPM)
result Establish theoretical guarantees for the associated two-sample testing procedure
New bounds use IPMs to improve generalization in machine learning.
problem Improving generalization bounds in machine learning.
method PAC-Bayes bounds with Integral Probability Metrics (IPM).
result Natural interpolation between worst-case and favorable cases.
The paper provides statistical guarantees for generative models using dimension reduction.
problem Improving the quality of generative models without increasing dimensionality.
method Modeling generative devices as smooth transformations of a lower-dimensional space and using integral probability metrics.
result Established a risk bound showing the impact of dimension reduction on generative model error.
A new IPM uses ReLU networks to measure probability discrepancies.
problem Measuring the difference between two probability distributions in high dimensions.
method Proposes a new parametric IPM using ReLU neural networks to optimize and distinguish between distributions.
result The proposed IPM has good convergence rates and can be used as a surrogate for other IPMs.
Quantum probability metrics improve distribution comparison in high dimensions.
problem Challenges in comparing probability distributions, especially in high-dimensional and non-compact domains.
method Quantum probability metrics (QPMs) derived from quantum state spaces, overcoming limitations of MMD.
result QPMs offer enhanced sensitivity to subtle distributional differences in high dimensions and improve performance in generative modeling.
Develops a new divergence framework that combines f-divergences and IPMs.
problem Comparing distributions that are not absolutely continuous.
method Introduces (f,Γ)-divergences as a two-stage mass-redistribution/mass-transport process. result Improves estimation, learning, and uncertainty quantification in GANs for heavy-tailed distributions.
The paper proposes a new method for covariate balancing using IPM to improve causal inference.
problem Covariate imbalance in causal inference weighting methods, especially when models are not correctly specified.
method The integral probability metric (IPM) is used to determine optimal weights for treated and control groups.
result The proposed method can be consistent without specifying either the propensity score or outcome regression model.
The paper explores statistical and topological properties of sliced probability divergences.
problem Understanding the topological, statistical, and computational consequences of slicing divergences.
method Deriving theoretical properties of sliced probability divergences, including metric axioms preservation and weak continuity.
result Sliced divergences share similar topological properties and have stable sample complexity.
New framework improves experimental design using integral probability metrics.
problem Challenges in Bayesian Optimal Experimental Design (BOED) with KL divergence.
method Integrates integral probability metrics (IPMs) for stability and flexibility.
result IPM-based designs yield more robust and accurate credible sets.
Paper proposes new density estimators for high-dimensional data.
problem Prohibitive computational cost and slow convergence rate in high-dimensional density estimation.
method Adaptive hyperbolic cross density estimators in mixed smooth Sobolev spaces.
result Proposed estimators do not suffer curse of dimensionality under Integral Probability Metrics.
Unified view of KL-divergence and IPMs via DRE, with new DRM metrics.
problem Unified understanding of KL-divergence and IPMs.
method Unified representation via maximum likelihood density-ratio estimation (DRE).
result Unified form of IPMs and novel DRM metrics.
Novel algorithm speeds up computation of Sobolev IPM for graph-based probability measures.
problem Efficient computation of Sobolev IPM for graph-based probability measures.
method Established relation between Sobolev norm and weighted Lp-norm, proposed novel regularization, leveraged graph structure. result Proposed regularized Sobolev IPM provides closed-form expression for fast computation.
This study analyzes how well GANs approximate distributions from small samples.
problem Understanding how well GANs approximate distributions from limited data.
method Analysis of GANs using integral probability metrics and Hölder classes.
result GANs can adaptively learn low-dimensional structures or Hölder densities.
A new method estimates multi-dimensional value distributions using Hilbert space embeddings.
problem Estimating value distributions in complex, multi-dimensional reinforcement learning settings.
method Hilbert space mappings and kernel mean embeddings to estimate the kernel mean embedding of multi-dimensional value distributions.
result Uniform convergence guarantees and robust off-policy evaluation demonstrated in simulations.
Identifies most probable flows for Kunita SDEs in fluid dynamics.
problem Modeling stochastic processes with Eulerian noise and deterministic drifts.
method Equipping the domain with a Riemannian metric from the noise, solving the resulting PDEs.
result Most probable flows differ from deterministic flows, especially under noise.
New metrics avoid high-dimensional analysis challenges, proving convergence without 'curse of dimensionality'.
problem High-dimensional analysis challenges in empirical measure convergence.
method Proposed a new class of probability metrics free of the curse of dimensionality.
result Convergence of empirical measures is free of the curse of dimensionality.
Paper proposes a new FRL algorithm for continuous sensitive attributes using EIPM.
problem Existing FRL algorithms cannot handle continuous sensitive attributes.
method Introduces EIPM to assess fairness in representation space for continuous attributes and proposes FREM algorithm.
result FREM outperforms other methods in fairness evaluation for continuous sensitive attributes.
New LFR algorithm ensures fair predictions with theoretical guarantees.
problem Ensuring fairness in AI algorithms for social decision-making.
method Proposes a new adversarial training scheme using IPM with a parametric family of discriminators.
result Theoretical guarantee of fairness in final prediction models.
Deep neural networks can approximate any target probability distribution given certain conditions.
problem Approximating complex probability distributions with deep neural networks.
method Proving the existence of a deep neural network mapping that approximates a target distribution under various integral probability metrics.
result Upper bounds on the size of the neural network in terms of dimension and approximation error for different metrics.
New findings show fixed-kernel discriminators are weaker than feature-learning ones.
problem Comparing performance of fixed-kernel and feature-learning discriminators.
method Using function classes F2 and F1, constructing pairs of distributions, and linking IPMs with sliced Wasserstein distances. result Fixed-kernel IPM and SD cannot discriminate certain distributions that feature-learning IPM and SD can.
We propose a general information-theoretic approach called Seraph (SEmi-supervised metRic leArning Paradigm with Hyper-sparsity) for metric learning that does not rely upon the manifold assumption. Given the probability parameterized by a Mahalanobis distance, we maximize the entropy of that probability on labeled data…
We propose a general information-theoretic approach called Seraph (SEmi-supervised metRic leArning Paradigm with Hyper-sparsity) for metric learning that does not rely upon the manifold assumption. Given the probability parameterized by a Mahalanobis distance, we maximize the entropy of that probability on labeled data…
Develops Stein's method for Riemannian manifolds using diffusion.
problem Bounding integral metrics on probability measures on Riemannian manifolds.
method Exploits the relationship between diffusion generators and Stein operators to derive Stein factors.
result Derives curvature-dependent Stein factors that generalize existing results for Euclidean spaces.
Paper proposes a new method to quantify uncertainty in machine learning models.
problem Quantifying uncertainty in multiclass classification models.
method Distance-based approach using Integral Probability Metrics (IPMs).
result Effective uncertainty measures for multiclass classification.
Establishes upper bounds on generalization error in active learning.
problem Improving query algorithms in active learning.
method Derives upper bounds on generalization error using informativeness and representativeness query strategies.
result Validates the use of regularization techniques to ensure bounds' validity.
A new distance metric compares probability distributions using kernel covariance operators.
problem Comparing probability distributions in machine learning tasks.
method Introduces a novel distance metric based on Schatten norm of kernel covariance operators.
result The new distance metric is more discriminative and robust to hyperparameters.
Proposes tests for comparing high-dimensional manifold samples.
problem Determining if two manifold samples come from the same distribution.
method Integral Probability Metric (IPM) with neural network approximations.
result Tests achieve type-II risk in specific orders of n. The paper extends Hoeffding's inequality for Markov chains using a generalized concentrability condition.
problem Applying Hoeffding's inequality to non-ergodic Markov chains.
method Integrates generalized concentrability condition via IPM to extend traditional hypotheses.
result Demonstrates utility in machine learning applications such as empirical risk minimization and bandits.
Paper discusses the Fisher metric and differentiability in statistical models.
problem Understanding the relationship between Fisher metric and differentiability in statistical models.
method Comparison of different concepts and models in Information Geometry, mathematical statistics, and measure theory.
result Discussion of various models and their differentiability properties.
Paper uses DNN-based MoM-GAN to estimate contaminated data distributions.
problem Estimating distributions of data with outliers or contamination.
method Combines GAN and MoM estimation with DNN for modeling.
result DNN-based MoM-GAN achieves better error bounds than other methods.
New test uses neural networks to compare distributions, outperforming traditional methods.
problem Comparing distributions in high dimensions and higher orders of smoothness.
method Integral probability metrics with Radon bounded variation functions and neural networks.
result The Radon-Kolmogorov-Smirnov (RKS) test outperforms traditional methods in distinguishing distributions.
Study of random sections on complex spaces converging to equilibrium metrics.
problem Understanding the behavior of random holomorphic sections on complex spaces.
method Analyzing the convergence of normalized Fubini-Study currents and integration currents to the equilibrium metric's curvature.
result The normalized currents of integration along zero divisors converge almost surely to the curvature current of the equilibrium metric.
We introduce new families of Integral Probability Metrics (IPM) for training Generative Adversarial Networks (GAN). Our IPMs are based on matching statistics of distributions embedded in a finite dimensional feature space. Mean and covariance feature matching IPMs allow for stable training of GANs, which we will call M…
The paper bounds the expectation of empirical processes indexed by Hölder classes.
problem Estimating the expectation of the supremum of empirical processes for distributions on bounded sets.
method Providing upper bounds on the expectation of the supremum of empirical processes indexed by Hölder classes.
result Deriving non-asymptotic risk bounds for estimating distributions using empirical processes and IPM.
We construct a Wasserstein gradient flow of the maximum mean discrepancy (MMD) and study its convergence properties. The MMD is an integral probability metric defined for a reproducing kernel Hilbert space (RKHS), and serves as a metric on probability measures for a sufficiently rich RKHS. We obtain conditions for conv…
Introduces a new geometric framework for probability distributions.
problem Developing a geometric framework for probability distributions.
method Introduces ℓp-information geometry and defines the ℓ2-probability simplex via the q-root transform. result Defines a noncanonical differentiable structure and q-root map as an isometry. Kernel DRO uses RKHS to optimize under distributional uncertainty.
problem Optimizing under distributional uncertainty with limited knowledge.
method Kernel DRO using RKHS ambiguity sets and duality theory.
result Unified approach to robust and stochastic optimization.
We propose a new class of metrics on sets, vectors, and functions that can be used in various stages of data mining, including exploratory data analysis, learning, and result interpretation. These new distance functions unify and generalize some of the popular metrics, such as the Jaccard and bag distances on sets, Man…
A new framework for offline RL improves policy flexibility and regularity.
problem Lack of environmental interactions in offline RL leads to poor policy performance.
method Proposes a behavior-regularized implicit policy framework with modified policy-matching methods.
result The framework improves policy effectiveness and robustness beyond static datasets.
Squared families are a new model class derived from linear transformations, offering convenient properties and universal approximation.
problem Developing a new class of probability models that are easier to handle and have useful properties.
method Introducing squared families as families of probability densities obtained by squaring a linear transformation of a statistic, and showing their properties and applications.
result Squared families have convenient properties and can approximate target densities well.
The paper explores theoretical insights into WGANs for better understanding and stability.
problem Stabilizing the training process of GANs.
method Theoretical analysis and statistical convergence study of WGANs.
result Theoretical properties and convergence of WGANs are clarified.
We study the geometry of the space of densities $\VolM$, which is the quotient space $\Diff(M)/\Diff_μ(M)$ of the diffeomorphism group of a compact manifold M by the subgroup of volume-preserving diffemorphisms, endowed with a right-invariant homogeneous Sobolev H˙1-metric. We construct an explicit isometry f…
This paper provides an existence-and-uniqueness theorem characterizing the stochastic integral with respect to a Wiener process. The integral is represented as a mapping from the space of measurable and adapted pathwise locally integrable processes to the space of continuous adapted processes. It is characterized in te…
Convolutional Bayesian filtering generalizes state estimation by incorporating inequality conditions.
problem Standard Bayesian filtering assumes exact conditional probabilities, limiting its applicability.
method Introducing inequality conditions transforms conditional probabilities into convolutional forms, expanding the filtering framework.
result Convolutional Bayesian filtering encompasses standard Bayesian filtering and allows for more nuanced model consideration.
Kernel quadrature improves CRPS estimation for probabilistic time-series forecasting.
problem Intractable integrations in CRPS evaluation metrics lead to improper rankings of forecasting models.
method Introduced kernel quadrature approach for unbiased CRPS estimation and scalable computation.
result Our approach consistently outperforms existing CRPS estimators.