Study minimax rates for density estimation under Huber contamination and Besov IPM losses.
problem Minimax convergence rates of nonparametric density estimation under Huber contamination model with outliers.
method Re-scaled thresholding wavelet series estimator and GAN architectures.
result Achieves minimax optimal convergence rates under Besov IPM losses.
Study nonparametric density estimation under Besov IPM losses and GANs.
problem Estimating nonparametric densities under various loss functions.
method Provide lower and upper bounds for convergence rates, formalize GANs as statistical models.
result IPMs can improve GANs' performance over linear estimators.
We introduce new families of Integral Probability Metrics (IPM) for training Generative Adversarial Networks (GAN). Our IPMs are based on matching statistics of distributions embedded in a finite dimensional feature space. Mean and covariance feature matching IPMs allow for stable training of GANs, which we will call M…
Wavelet-based online learning adapts to noisy Besov spaces with high probability.
problem Minimizing integrated squared error in Besov spaces with noisy observations.
method Adaptive wavelet-based online learning algorithm that dynamically adjusts to gradient noise.
result Achieves minimax-optimal integrated squared error with high probability.
Estimating IPM is as hard as estimating under IPM, both requiring similar optimal rates.
problem Estimating Integral Probability Metrics (IPMs) between probability measures.
method Study of minimax optimal rates for IPM estimation and under IPM estimation based on samples.
result Minimax optimal rates for estimating IPM and estimating under IPM are multiplicatively equivalent.
Novel algorithm speeds up computation of Sobolev IPM for graph-based probability measures.
problem Efficient computation of Sobolev IPM for graph-based probability measures.
method Established relation between Sobolev norm and weighted L p L^p L p -norm, proposed novel regularization, leveraged graph structure. result Proposed regularized Sobolev IPM provides closed-form expression for fast computation.
The paper explores fair predictors in supervised learning using IPMs and Kolmogorov distance.
problem Achieving fairness in supervised learning with significant demographic effects.
method Identifying conditions for SP-fair predictors and using IPMs to measure unfairness.
result Fair predictors can improve accuracy and are computationally efficient.
Adaptive algorithm minimizes online prediction errors for irregular data.
problem Online adversarial regression with highly irregular prediction rules.
method Adaptive wavelet-based algorithm for Besov space regression.
result Minimax-optimal regret bounds in adversarial settings.
We propose a new Integral Probability Metric (IPM) between distributions: the Sobolev IPM. The Sobolev IPM compares the mean discrepancy of two distributions for functions (critic) restricted to a Sobolev ball defined with respect to a dominant measure μ μ μ . We show that the Sobolev IPM compares two distributions in hig…
Unified view of KL-divergence and IPMs via DRE, with new DRM metrics.
problem Unified understanding of KL-divergence and IPMs.
method Unified representation via maximum likelihood density-ratio estimation (DRE).
result Unified form of IPMs and novel DRM metrics.
A new IPM uses ReLU networks to measure probability discrepancies.
problem Measuring the difference between two probability distributions in high dimensions.
method Proposes a new parametric IPM using ReLU neural networks to optimize and distinguish between distributions.
result The proposed IPM has good convergence rates and can be used as a surrogate for other IPMs.
This paper is concerned with sequential filtering based stochastic optimization (FSO) approaches that leverage a probabilistic perspective to implement the incremental proximity method (IPM). The present FSO methods are derived based on the Kalman filter (KF) and the extended KF (EKF). In contrast with typical methods …
Generalizes Sobolev IPM for graph-based measures using Orlicz geometric structure.
problem Limitation of Le et al. (2025) framework to L p L^p L p geometry. method Generalizes Sobolev IPM through Orlicz geometric structure, employing convex functions to capture nuanced geometric relationships.
result GSI-M reduces to a simple univariate optimization problem, achieving remarkable computational efficiency.
Deep ReLU networks learn optimally in Besov spaces, overcoming dimensionality issues.
problem Understanding the adaptivity and optimal performance of deep learning in complex function spaces.
method Approximation and estimation error analysis of deep learning with ReLU activation in Besov and mixed smooth Besov spaces.
result Deep learning achieves the minimax optimal rate and outperforms non-adaptive estimators in Besov spaces.
As an effective way of metric learning, triplet loss has been widely used in many deep learning tasks, including face recognition and person-ReID, leading to many states of the arts. The main innovation of triplet loss is using feature map to replace softmax in the classification task. Inspired by this concept, we prop…
Bayesian nonparametric LABS model adapts to function smoothness in Besov spaces.
problem Estimating functions with unknown smoothness in Besov spaces.
method Lévy Adaptive B-spline (LABS) regression model with automatic smoothness adaptation.
result LABS posterior contracts around true function in Besov classes at nearly minimax-optimal rates.
Kolmogorov-Arnold Networks improve deep learning adaptivity and can approximate Besov functions optimally.
problem Improving deep learning adaptivity and understanding approximation rates.
method Analyzing Besov norms and using Res-KANs for approximation.
result KANs can optimally approximate Besov functions at the optimal rate.
Diffusion models achieve nearly optimal distribution estimation in various spaces.
problem Theoretical limitations of diffusion modeling for distribution estimation.
method Analysis of approximation and generalization abilities of diffusion models in Besov spaces.
result Diffusion models achieve nearly minimax optimal estimation rates in total variation and Wasserstein distances.
This paper studies continuum-armed bandits under Besov smoothness conditions and derives minimax rates.
problem Optimizing an unknown function with limited evaluations.
method Studies continuum-armed bandits under Besov smoothness conditions and derives minimax rates.
result Minimax rates over Besov spaces are identical to those over the smallest Hölder space into which Besov spaces embed.
Bayesian neural networks achieve optimal posterior contraction rates in Besov spaces with intrinsic dimensionality.
problem High-dimensional structured estimation problems with unknown smoothness levels.
method Sparse Bayesian neural networks with either sparse or continuous shrinkage priors.
result Optimal posterior contraction rates are achieved, adapting to the unknown smoothness level of the true function.
New cyclicity measures defined in weighted Besov spaces, with stability and geometric analysis.
problem Characterizing cyclicity in weighted Besov spaces.
method Defining cyclicity indices based on potential theory and capacity, studying stability under perturbations, and linking zero set structure to cyclicity.
result Novel invariants and conditions for cyclicity in various function spaces.
Study analyzes deep learning's performance on variable exponent Besov space, highlighting adaptivity benefits.
problem Estimation error analysis of deep learning in variable exponent Besov space.
method Analysis of general approximation error and estimation errors of deep learning.
result Adaptivity of deep learning leads to significant improvement in estimation error, especially in high-dimensional spaces.
Toda flow explained as a porous medium equation.
problem Understanding the Toda flow through the lens of porous medium equations.
method Analyzing the geometry and dynamics of the porous medium equation and comparing it to the Toda flow.
result The Toda flow can be represented as a specific porous medium equation, revealing its gradient and Hamiltonian nature.
Proposes tests for comparing high-dimensional manifold samples.
problem Determining if two manifold samples come from the same distribution.
method Integral Probability Metric (IPM) with neural network approximations.
result Tests achieve type-II risk in specific orders of n n n . New framework improves experimental design using integral probability metrics.
problem Challenges in Bayesian Optimal Experimental Design (BOED) with KL divergence.
method Integrates integral probability metrics (IPMs) for stability and flexibility.
result IPM-based designs yield more robust and accurate credible sets.
New bounds use IPMs to improve generalization in machine learning.
problem Improving generalization bounds in machine learning.
method PAC-Bayes bounds with Integral Probability Metrics (IPM).
result Natural interpolation between worst-case and favorable cases.
IPMs struggle with hyperbolic spaces due to polynomially growing barrier parameters.
problem IPMs' efficiency is hindered in hyperbolic spaces.
method Analyzing the barrier parameter growth in hyperbolic and Hadamard spaces.
result The barrier parameter grows polynomially with the domain's diameter in hyperbolic spaces.
Bayesian neural network achieves nearly optimal performance in Besov space.
problem Bayesian neural networks in Besov space.
method Spike-and-slab prior and shrinkage prior for posterior convergence rate.
result The posterior convergence rate is nearly minimax and adaptive to unknown smoothness.
New spatiotemporal Besov process improves CT image reconstruction and other inverse problems.
problem Handling abrupt changes and sharp contrasts in spatiotemporal data.
method Generalized Besov process (STBP) with Q-exponential process for temporal correlation.
result STBP outperforms traditional methods in dynamic reconstruction and inverse problems.
Deep ReLU networks approximate functions in Sobolev and Besov spaces efficiently.
problem Efficiently approximating functions in Sobolev and Besov spaces using deep ReLU networks.
method Novel bit-extraction technique and VC-dimension method for deriving approximation bounds.
result Sharp upper and lower bounds for L p L_p L p -approximation of functions in Sobolev and Besov spaces. Bayesian KANs achieve near-minimax posterior contraction rates in anisotropic Besov spaces.
problem Statistical foundation for Bayesian Kolmogorov-Arnold networks in anisotropic Besov spaces.
method Sparse Bayesian KANs with spike-and-slab priors, hyperprior on model size, and approximation complexity bounds.
result Posterior contraction rates depend on intrinsic anisotropic smoothness and effective dimension of the compositional structure.
Study extends DRO with IPMs, linking robustness to regularization and GANs.
problem Addressing robustness of deep neural networks to adversarial attacks.
method Distributionally Robust Optimization (DRO) with Integral Probability Metrics (IPMs).
result DRO under any IPM corresponds to a family of regularization penalties.
A new meta-learning framework that assigns weights to source tasks based on target samples.
problem Learning initialization for target tasks with limited labeled examples.
method A general framework that assigns weights to the loss of different source tasks, which can depend on the target samples. Provides upper bounds and develops a learning algorithm based on minimizing the error bound with respect to an empirical IPM.
result Empirically, the weighted meta-learning algorithm finds better initializations than uniformly-weighted meta-learning algorithms.
Characterizes when differential forms have weak exterior derivatives based on limiting behavior of integration over simplices.
problem Characterizing differential forms with weak exterior derivatives.
method Uses integration over simplices to characterize the limiting behavior of differential forms.
result Proves a direct analogue of the Bourgain-Brezis-Mironescu characterization for differential forms.
Paper studies optimal federated learning for nonparametric regression with privacy constraints.
problem Federated learning for nonparametric regression with heterogeneous differential privacy constraints.
method Proposes distributed privacy-preserving estimators and investigates their risk properties.
result Establishes matching minimax lower bounds for global and pointwise estimation.
Improved image generation quality using closed-form discriminator guidance in diffusion models.
problem Enhancing the quality of images generated by diffusion models.
method Theoretical framework to analyze GAN discriminator's effect on Langevin sampling, proposing IPM-GAN optimization as smoothed score-matching.
result Closed-form kernel-based discriminator guidance improves metrics like CLIP-FID and KID.
Deep learning performs well on high-dimensional data with anisotropic smoothness.
problem Understanding the performance of deep learning on high-dimensional datasets with varying smoothness.
method Investigated approximation and estimation errors in anisotropic Besov spaces.
result Deep learning's performance depends on the average smoothness, avoiding curse of dimensionality.
Deep ReLU networks can efficiently approximate Sobolev and Besov functions.
problem Approximating functions in Sobolev and Besov spaces using deep neural networks.
method Used deep ReLU neural networks with varied width and depth to approximate functions in Sobolev and Besov spaces.
result Generalized the approximation rate to hold under the Sobolev embedding condition.
ConvResNets approximate Besov functions and classify on low-dimensional manifolds.
problem Lack of statistical theories for deep learning on high-dimensional data.
method Exploits low-dimensional geometric structures of real-world data sets using ConvResNets.
result ConvResNets can approximate Besov functions and learn classifiers with optimal excess risk.
New error bounds for GANs with nonlinear objective functions derived.
problem Statistical consistency of GANs with nonlinear objective functions.
method Derivation of statistical error bounds for ( f , Γ ) (f,Γ) ( f , Γ ) -GANs using Rademacher complexity. result Proves the statistical consistency of ( f , Γ ) (f,Γ) ( f , Γ ) -GANs. A nonparametric two-sample test using a parametric integral probability metric
problem Detecting distributional differences between two independent samples
method Propose a new two-sample test statistic based on a newly introduced integral probability metric (IPM)
result Establish theoretical guarantees for the associated two-sample testing procedure
In this paper we propose a function space approach to Representation Learning and the analysis of the representation layers in deep learning architectures. We show how to compute a weak-type Besov smoothness index that quantifies the geometry of the clustering in the feature space. This approach was already applied suc…
Study on distributed nonparametric function estimation with optimal rate and cost of adaptation.
problem Optimal rate of convergence and cost of adaptation in distributed nonparametric function estimation.
method Distributed minimax estimation and adaptive estimation under communication constraints for Gaussian sequence model and white noise model.
result Established minimax rate of convergence and exact communication cost for adaptation.
The paper proposes a new method for covariate balancing using IPM to improve causal inference.
problem Covariate imbalance in causal inference weighting methods, especially when models are not correctly specified.
method The integral probability metric (IPM) is used to determine optimal weights for treated and control groups.
result The proposed method can be consistent without specifying either the propensity score or outcome regression model.
Extends Onsager's conjecture to Besov spaces on manifolds with boundary.
problem Proving Onsager's conjecture on Riemannian manifolds with boundary.
method Constructing Hodge-Neumann heat kernel, obtaining off-diagonal decay and local Bernstein estimates.
result Extends Onsager's conjecture to Besov spaces B ^ 3 , V 1 3 \widehat{B}_{3,V}^{\frac{1}{3}} B 3 , V 3 1 . Develops a new divergence framework that combines f f f -divergences and IPMs.
problem Comparing distributions that are not absolutely continuous.
method Introduces ( f , Γ ) (f,Γ) ( f , Γ ) -divergences as a two-stage mass-redistribution/mass-transport process. result Improves estimation, learning, and uncertainty quantification in GANs for heavy-tailed distributions.
A new GAN model uses characteristic functions to improve image generation.
problem Improving stability and diversity in GANs for complex distributions.
method Integrates characteristic functions to compare distributions directly, stabilizes training, and uses auto-encoder structure.
result Proposes RCF-GAN achieving superior image generation and reconstruction.
Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates that are minimax optimal modulo a logarithmic factor if Gaussian RBF kernels are u…