Study exact minimax rates for density estimation over convex classes, extending previous work.
problem Deriving minimax rates for density estimation over convex density classes.
method Building on Le Cam's work, determine exact minimax rates using local metric entropy.
result Exact minimax rates derived for any convex density class, including nonparametric and parametric cases.
Geodesic balls are isoperimetric in hyperbolic spaces with certain densities.
problem Proving isoperimetric properties in hyperbolic spaces with specific densities.
method Using geodesic balls and radial, strictly log-convex densities.
result Geodesic balls are isoperimetric in real hyperbolic space HRn. We construct geodesics in the Wasserstein space of probability measure along which all the measures have an upper bound on their density that is determined by the densities of the endpoints of the geodesic. Using these geodesics we show that a local Poincaré inequality and the measure contraction property follow from t…
The paper proves new inequalities in hyperbolic space using Euclidean methods.
problem Proving weighted isoperimetric inequalities in hyperbolic space.
method Using isoperimetric inequality with log-convex density in Euclidean space.
result Removed horo-convex assumption and proved new inequalities for star-shaped domains.
We construct an infinite-dimensional information manifold based on exponential Orlicz spaces without using the notion of exponential convergence. We then show that convex mixtures of probability densities lie on the same connected component of this manifold, and characterize the class of densities for which this mixtur…
We show that the energy density of critical points of a class of conformally invariant variational problems with small energy on the unit 2-disk B_1 lies in the local Hardy space h^1(B_1). As a corollary we obtain a new proof of the energy convexity and uniqueness result for weakly harmonic maps with small energy on B_…
Unique floating and buoyancy surfaces identify convex polytopes.
problem Identifying convex polytopes from their flotation and buoyancy surfaces.
method Proving uniqueness of surfaces for polytopes with uniform or prescribed density.
result Floating and buoyancy surfaces uniquely determine convex polytopes.
We completely characterize isoperimetric regions in R^n with density e^h, where h is convex, smooth, and radially symmetric. In particular, balls around the origin constitute isoperimetric regions of any given volume, proving the Log-Convex Density Conjecture due to Kenneth Brakke.
We examine the vertical component of surface area in the warped product of a Euclidean interval and a fiber manifold with product density. We determine general conditions under which vertical fibers minimize vertical surface area among regions bounding the same volume and use these results to conclude that in many such…
Paper proposes a new method for density estimation using squared Hellinger distance.
problem Density estimation using moment methods is sensitive to the choice of functions.
method Proposes a non-classical parametrization using squared Hellinger distance for density estimation.
result The proposed method does not require choosing functions and can be solved by convex optimization.
Unique entropy measure found for convex projective manifolds.
problem Entropy measure for convex projective manifolds.
method Developed Patterson--Sullivan densities and mixing theory.
result Unique mixing measure of maximal entropy exists.
Solves a general class of free boundary Monge-Ampère equations.
problem Optimal transport with degenerate densities and geometric problems.
method Analyzes a specific class of Monge-Ampère equations and their applications.
result Solves the equations for a general class, including applications to optimal transport and geometric problems.
We consider the problem of sampling from a density of the form p(x)∝exp(−f(x)−g(x)), where f:Rd→R is a smooth and strongly convex function and g:Rd→R is a convex and Lipschitz function. We propose a new algorithm based on the Metropolis-Has…
Dual-ISL improves implicit generative model training with convex optimization and explicit density approximation.
problem Training implicit generative models with robust and practical likelihood-free objectives.
method Introduces dual-ISL, a novel likelihood-free objective using a convex divergence derived from the invariant statistical loss (ISL) framework.
result Dual-ISL yields a convex optimization problem in the space of model densities, providing explicit density approximation and improved training stability.
Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of prediction accuracy. We assume only that the densities have a convex parametrization …
We define and compute plausible counterfactual explanations using density constraints.
problem Efficiently compute plausible counterfactual explanations for machine learning models.
method Propose and study a formal definition of plausible counterfactual explanations, use density estimators, and introduce convex density constraints.
result Convex density constraints ensure plausible and feasible counterfactual explanations.
New method recovers clusters in non-convex finite metric spaces with oracle queries.
problem Exact recovery of clusters in non-convex finite metric spaces.
method Introducing (β,γ)-convexity and a deterministic algorithm using oracle queries. result Clusters can be recovered using O(k2logn+k2(6/βγ)dens(X)) same-cluster queries. We consider the problem of finding critical points of functions that are non-convex and non-smooth. Studying a fairly broad class of such problems, we analyze the behavior of three gradient-based methods (gradient descent, proximal update, and Frank-Wolfe update). For each of these methods, we establish rates of conver…
The paper studies geometric properties of hydrodynamical density manifolds.
problem Understanding the geometry of hydrodynamical density manifolds.
method Formulating connections, gradients, Hessians, parallel transports, and curvatures on these manifolds.
result Closed-form formulas for sectional curvatures in one-dimensional density manifolds.
Study minimax risk of score estimation for log-concave distributions.
problem Minimizing risk in score estimation for log-concave distributions.
method Developed subclasses of log-concave densities and constructed a locally adaptive, multiscale estimator.
result Established minimax rates for score estimation over specific subclasses of log-concave densities.
Introduces HMC method for sampling Gibbs densities.
problem Sampling from Gibbs densities efficiently.
method Hamiltonian Monte Carlo (HMC) method based on Hamiltonian dynamics.
result Idealized HMC preserves the target distribution and converges under certain conditions.
Sharp curvature estimates lead to optimal C1,1 regularity for Lp Minkowski problems.
problem Optimal regularity for solutions to Lp Minkowski problems. method Anisotropic Gauss curvature flows and curvature estimates.
result Sharp C1,1 regularity for solutions to Lp Minkowski problems. Estimates nonparametric densities from mixed samples.
problem Unmixing convex combinations of nonparametric densities from observed groups.
method Proposes an estimator using topic modeling and U-statistics.
result Rate-optimal estimator for nonparametric density estimation.
G-GLN extends GLNs to multiple regression and density modeling.
problem Learning features in deep neural networks.
method G-GLN uses a distributed and local credit assignment mechanism based on optimizing a convex objective.
result G-GLN achieves competitive or state-of-the-art performance on regression benchmarks.
We study the isoperimetric problem for Euclidean space endowed with a continuous density. In dimension one, we characterize isoperimetric regions for a unimodal density. In higher dimensions, we prove existence results and we derive stability conditions, which lead to the conjecture that for a radial log-convex density…
Optimum in Convex Hulls (OCH) generalizes clinical trial results to broader populations.
problem Clinical trials exclude confounding but limit recruitment; observational data are more inclusive but suffer from confounding.
method OCH uses convex hulls of conditional expectations or densities to approximate the true treatment effect from both observational and trial data.
result OCH estimates the treatment effect with state-of-the-art accuracy in terms of both expectations and densities.
It is known that by dualizing the Bochner-Lichnerowicz-Weitzenböck formula, one obtains Poincaré-type inequalities on Riemannian manifolds equipped with a density, which satisfy the Bakry-Émery Curvature-Dimension condition (combining a lower bound on its generalized Ricci curvature and an upper bound on its generalize…
Optimal scaling for proximal MALA in high dimensions confirmed.
problem Optimizing sampling efficiency in high-dimensional target densities.
method Introduced and analyzed the proximal MALA algorithm, showing it maintains optimal scaling.
result Proximal MALA achieves optimal scaling in high dimensions with an average acceptance probability of 0.574.
Proves stability of cone-volume measure with nearly constant density.
problem Stability of cone-volume measure with near constant density.
method Proves stability of cone-volume measure with near constant density.
result Homothetic copy of the body is close to the unit ball in the L2-distance. Unified framework for estimating density ratios across multiple distributions.
problem Binary density ratio estimation for multiple distributions.
method Unified framework based on Bregman divergence minimization.
result Generalization of binary DRE methods to multiple distributions.
New algorithm tames non-linear growth in stochastic optimization.
problem Computational challenges in E-step of EM framework.
method Employing interacting particle systems and taming techniques to create tIPLA.
result Non-asymptotic convergence error estimates in Wasserstein-2 distance for tIPLA.
New definition of metric current yields Finsler geometry volume densities.
problem Defining volume functionals from Finsler geometry.
method Proposed a new definition of metric current and showed its utility.
result Obtained a family of extendibly convex volume densities.
We consider a smooth Euclidean solid cone endowed with a smooth homogeneous density function used to weight Euclidean volume and hypersurface area. By assuming convexity of the cone and a curvature-dimension condition we prove that the unique compact, orientable, second order minima of the weighted area under variation…
For an infinite cardinal κ let ℓ2(κ) be the linear hull of the standard othonormal base of the Hilbert space ℓ2(κ) of density κ. We prove that a non-separable convex subset X of density κ in a locally convex linear metric space if homeomorphic to the space (i) ℓ2f(κ) if and only if X can be…
Estimates log-concave densities in graphical models using tent functions.
problem Maximum likelihood estimation of log-concave densities in undirected graphs.
method MLE as product of tent functions corresponding to maximal cliques.
result MLE can be found via convex optimization.
Study on regularity of optimal transport maps on convex domains with quadratic cost.
problem Regularity of optimal transport maps between convex domains with quadratic cost.
method Analysis of Cα-densities and C1,α boundary conditions, monotonicity formula for optimal transport maps. result Proves C1,1−ε-regularity for nondegenerate Cα-densities and C2,α-regularity for C1,α boundary. We prove some old and new isoperimetric inequalities with the best constant using the ABP method applied to an appropriate linear Neumann problem. More precisely, we obtain a new family of sharp isoperimetric inequalities with weights (also called densities) in open convex cones of Rn. Our result applies to…
The paper tackles MAP inference over non-convex constraints in safety-critical settings.
problem Efficiently computing MAP predictions subject to non-convex constraints is challenging.
method The paper investigates conditions for exact and efficient MAP inference over continuous variables and devises scalable algorithms for both tractable and general cases.
result The proposed methods outperform constraint-agnostic baselines and scale to complex densities.
The classic double bubble theorem says that the least-perimeter way to enclose and separate two prescribed volumes in RN is the standard double bubble. We seek the optimal double bubble in RN with density, which we assume to be strictly log-convex. For N=1 we show that the solution is sometime…
Method reduces categorical data to lower dimensions using density matrices.
problem Dimensionality reduction for categorical data.
method Density-matrix construction from class-conditional frequencies; spectral embedding.
result Low-dimensional spectral embeddings with controlled rank.
An image pattern can be represented by a probability distribution whose density is concentrated on different low-dimensional subspaces in the high-dimensional image space. Such probability densities have an astronomical number of local modes corresponding to typical pattern appearances. Related groups of modes can join…
New method estimates density ratio for well-separated distributions using multi-class logistic regression.
problem Challenges in estimating density ratio for well-separated distributions.
method Uses multi-class logistic regression with auxiliary densities to estimate log(p/q).
result Demonstrates superior performance on density ratio estimation, mutual information, and representation learning tasks.
The paper explores optimal regularizers for data sources, linking them to star bodies.
problem Understanding optimal regularizers for data sources.
method Investigates optimal regularizers for data distributions using star bodies and dual Brunn-Minkowski theory.
result Identifies optimal regularizers and assesses amenability to convex regularization.
Unified framework for OOD detection using class ratio estimation.
problem Density-based OOD detection is unreliable for OOD images.
method Unified framework that builds energy-based models and employs differing base distributions, directly estimating the density ratio through class ratio estimation.
result Competitive results on OOD image problems compared to recent work.
The paper corrects the use of the transverse density bundle in Lie groupoids.
problem Incorrect use of the transverse density bundle in Lie groupoids.
method Revisiting and clarifying the concepts of transverse density bundle and modular classes.
result The transverse density bundle should be used instead of the common representation QA. Let Sm be the set of all m×m density matrices (Hermitian positively semi-definite matrices of unit trace). Consider a problem of estimation of an unknown density matrix ρ∈Sm based on outcomes of n measurements of observables X1,…,Xn∈Hm (Hm bei…
We introduce a new volume definition on normed vector spaces. We show that the induced k-area functionals are convex for all k. In the particular case k=2, our theorem implies that Busemann's 2-volume density is convex, which was recently shown by Burago-Ivanov. We also show how the new volume definition is relat…
In this work, we propose new objective functions to train deep neural network based density ratio estimators and apply it to a change point detection problem. Existing methods use linear combinations of kernels to approximate the density ratio function by solving a convex constrained minimization problem. Approximating…