Study on manifolds with density using modified Hessians for curvature comparison.
problem Developing comparison geometry on manifolds with density.
method Modified Hessian approach based on weighted sectional curvature framework.
result Derivation of Hessian comparison and shape operator comparison theorems.
Efron et al. (2001) proposed empirical Bayes formulation of the frequentist Benjamini and Hochbergs False Discovery Rate method (Benjamini and Hochberg,1995). This article attempts to unify the `two cultures' using concepts of comparison density and distribution function. We have also shown how almost all of the existi…
Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution comparison such as outlier detection, transfer learning, and two-sample homogeneity…
Estimates density ratio for two-sample comparison using tree models.
problem Comparing two distributions given i.i.d. observations.
method Additive tree models with balancing loss for density ratio estimation.
result Bayesian inference provides uncertainty quantification for density ratio.
New method improves ABC for Bayesian model comparison.
problem Comparing complex models with observed data.
method Approximate Bayesian Computation with posterior density estimation.
result Efficiently assigns high posterior probabilities to ground-truth models.
A novel method compares 3D point clouds using information geometry.
problem Comparing 3D point clouds in machine learning applications.
method Interprets point clouds as probability density functions on a statistical manifold, using GMM and Modified Symmetric KL divergence.
result Demonstrates effectiveness through various case studies.
This study compares financial density forecasts using risk-neutral and historical schemes.
problem Comparing the forecasting ability of risk-neutral and historical financial density models.
method Comprehensive comparison of 15 predictive schemes over 21 years, evaluating statistical consistency, local accuracy, and forecasting errors.
result Risk-neutral densities outperform historical-based predictions in terms of information content.
The paper studies curvature bounds for manifolds with density.
problem Curvature bounds for Riemannian manifolds with density.
method Develops new tools for studying weighted sectional curvature bounds, including a weighted Rauch comparison theorem and a modified convexity notion.
result Improves results for spaces of positive weighted sectional curvature and symmetry.
Develops a new test for comparing two groups' densities, showing minimax optimality.
problem Comparing probability densities between two groups.
method Probabilistic tensor product smoothing spline framework for joint density modeling; penalized likelihood ratio test for interaction testing.
result Proposed test is minimax optimal and outperforms conventional approaches.
Meta-learning improves relative density-ratio estimation from limited data.
problem Estimating relative density-ratios from few instances.
method Meta-learning using neural networks to extract and embed dataset information for relative DRE.
result Meta-learning enables efficient and effective adaptation to few instances for relative DRE.
A new density model using Fourier basis achieves better approximations and compression.
problem Approximating multi-modal 1D densities.
method Constrained Fourier basis model for end-to-end training.
result Lower cross entropy compared to deep factorized models.
A new method using normalizing flows speeds up Bayesian model comparison.
problem Computational challenges in calculating Bayesian evidence for complex models.
method Savage-Dickey density ratio with normalizing flows.
result The method scales to high-dimensional settings and provides consistent Bayes factors.
We introduce RNADE, a new model for joint density estimation of real-valued vectors. Our model calculates the density of a datapoint as the product of one-dimensional conditionals modeled using mixture density networks with shared parameters. RNADE learns a distributed representation of the data, while having a tractab…
Study lower weighted Ricci curvature bounds on manifolds with boundary.
problem Comparing geometric properties of manifolds with boundary under curvature constraints.
method Lower weighted Ricci curvature bound and boundary conditions.
result Various comparison geometric results under the curvature condition.
GANs struggle with density estimation on simple datasets, while normalizing flows perform well.
problem Comparing GANs and normalizing flows for density estimation on non-image data.
method An extensive grid search over GAN architectures, hyperparameters, and training procedures; comparison on low-dimensional synthetic datasets.
result Normalizing flows outperform GANs in density estimation, especially in terms of Wasserstein distance.
Efficiently infers Gaussian process density models with Gibbs sampling and variational methods.
problem Density estimation for complex, nonparametric models.
method Augmented likelihood with latent variables, Gibbs sampling, and variational mean field approximations.
result Efficient inference for Gaussian process density models with up to thousands of data points.
Evidence Networks simplify Bayesian model comparison for complex models.
problem Bayesian model comparison challenges with intractable likelihoods or priors.
method Loss functions and neural networks for fast, amortized estimation of Bayes factors.
result Evidence Networks provide accurate and scalable Bayes factor estimation.
This article proposes a novel density estimation based algorithm for carrying out supervised machine learning. The proposed algorithm features O(n) time complexity for generating a classifier, where n is the number of sampling instances in the training dataset. This feature is highly desirable in contemporary applicati…
Nested sampling improved for arbitrary priors.
problem Technical obstacle to using nested sampling with arbitrary priors.
method Parametric bijectors trained on samples from a desired prior density.
result Nested sampling can be used with arbitrary priors.
Unified framework for OOD detection using class ratio estimation.
problem Density-based OOD detection is unreliable for OOD images.
method Unified framework that builds energy-based models and employs differing base distributions, directly estimating the density ratio through class ratio estimation.
result Competitive results on OOD image problems compared to recent work.
This survey explores various optimality concepts in importance sampling.
problem Designing optimal proposal densities for Monte Carlo methods.
method Review of multiple frameworks and theoretical comparisons.
result Comprehensive understanding of optimality in importance sampling.
New test compares data to ergodic Markov models without specifying an alternative.
problem Testing goodness of fit for ergodic Markov processes without an alternative model.
method Density-based test comparing data to specified models' stationary densities.
result Test provides new insights into econometric and financial modeling.
Proposes a new hierarchical clustering method combining DP and DBSCAN strengths.
problem Combining strengths of DP and DBSCAN for arbitrary shape clusters.
method DC-HDP: Combines Density Peak and Density-Connectivity approaches.
result Produces best clustering results on 14 datasets.
New method identifies common organizational principles in networks.
problem Challenging to cluster networks of different size and density.
method Introduces a new network comparison methodology.
result Identifies common organizational principles in networks.
Study the hitting density of Ornstein-Uhlenbeck process, providing semi-analytical solutions.
problem First passage hitting density of Ornstein-Uhlenbeck process.
method Two complementary formulations, heat potentials, linear Volterra integral equations, Abel equation approximation, numerical solutions.
result Semi-analytical solutions for hitting density of Ornstein-Uhlenbeck process.
We consider odd Laplace operators acting on densities of various weight on an odd Poisson (= Schouten) manifold M. We prove that the case of densities of weight 1/2 (half-densities) is distinguished by the existence of a unique odd Laplace operator depending only on a point of an ``orbit space'' of volume forms. This…
A new noise model for preferential Bayesian optimization using user anchors.
problem Inadequate assumption of homoscedastic noise in human-in-the-loop settings.
method Proposes a heteroscedastic noise model with anchors and a KDE uncertainty map.
result Risk-adjusted performance improvement and clarified anchor placement effects.
GBHT uses gradient boosting for density estimation with theoretical guarantees.
problem Density estimation for unsupervised learning.
method Gradient Boosting Histogram Transform (GBHT) with Negative Log Likelihood loss.
result GBHT achieves faster convergence rates and better performance than base learners in density estimation.
DoSE improves OOD detection by estimating model probability density.
problem Poor specificity of model likelihoods for OOD detection.
method DoSE uses density of states concept to avoid direct model probability comparison.
result DoSE achieves state-of-the-art performance on OOD detection benchmarks.
Introduces neural point-forms for learning geometric features from noisy point clouds.
problem Learning geometric features from noisy point clouds with missing tangency information.
method Uses Laplacian-based techniques to build comparison matrices for point clouds, proving consistency under various assumptions.
result Neural point-forms provide a competitive and interpretable representation, especially beneficial for dense or manifold-like structures.
In the present paper, given an evolving mixture of probability densities, we define a candidate diffusion process whose marginal law follows the same evolution. We derive as a particular case a stochastic differential equation (SDE) admitting a unique strong solution and whose density evolves as a mixture of Gaussian d…
We explore the performance of several automatic bandwidth selectors, originally designed for density gradient estimation, as data-based procedures for nonparametric, modal clustering. The key tool to obtain a clustering from density gradient estimators is the mean shift algorithm, which allows to obtain a partition not…
The leverage effect refers to the well-established relationship between returns and volatility. When returns fall, volatility increases. We examine the role of the leverage effect with regards to generating density forecasts of equity returns using well-known observation and parameter-driven volatility models. These mo…
Paper proposes a new method for density estimation using squared Hellinger distance.
problem Density estimation using moment methods is sensitive to the choice of functions.
method Proposes a non-classical parametrization using squared Hellinger distance for density estimation.
result The proposed method does not require choosing functions and can be solved by convex optimization.
Study reveals 1/f noise in signals made from nonoverlapping rectangular pulses.
problem Analyzing 1/f noise in signals composed of nonoverlapping pulses. method Derived a general formula for power spectral density, analyzed rectangular pulse case.
result Observed pure 1/f noise until very low frequencies with long pulse durations. Paper tackles privacy-preserving data density issues using deconvolution.
problem Privacy-preserving noise affects data density, leading to under/over-estimation.
method Develops deconvoluting kernel density estimators and regression models.
result Demonstrates improved accuracy in estimating heavy-hitters with locally differential data.
Proposes a new clustering algorithm using random forest.
problem Density-based clustering with optimal level determination.
method Best-scored random forest algorithm.
result Guaranteed consistency and fast convergence rates.
Study post-hoc Learning to Defer using density-ratio losses.
problem Optimizing decision-making between models and experts.
method Density-ratio losses for post-hoc L2D scorers, derived from class-probability estimation.
result The approach recovers known results and introduces new connections to expert comparison and anomaly detection.
This work explores CS-RBFs as novel probability density functions.
problem Underexplored use of CS-RBFs in statistics and probability modeling.
method Derivation of statistical properties of CS-RBFs as univariate and conditional densities, analysis of mixture models, and introduction of an incremental learning algorithm.
result CS-RBF densities provide competitive results in likelihood and model complexity compared to Gaussian mixture models.
Survey of Monte Carlo methods for noisy, costly densities in reinforcement learning and ABC.
problem Dealing with intractable, costly, and noisy densities in real-world scenarios.
method Classification and description of Monte Carlo methodologies using surrogate models.
result Unified scheme and numerical comparisons of different methodologies.
We study a new ensemble of random correlation matrices related to multivariate Student (or more generally elliptic) random variables. We establish the exact density of states of empirical correlation matrices that generalizes the Marcenko-Pastur result. The comparison between the theoretical density of states in the St…
SC improves robustness in model comparison for misspecified models.
problem Model misspecification challenges in amortized Bayesian inference.
method Parameter posterior-based methods augmented with SC training.
result SC improves robustness under model misspecification.
REGS samples from unnormalized distributions using gradient flow and neural networks.
problem Sampling from unnormalized distributions with high accuracy and efficiency.
method REGS is a particle method that iteratively transforms samples from a reference distribution to match an unnormalized target distribution using Wasserstein gradient flow and neural networks.
result REGS outperforms state-of-the-art methods in sampling from challenging multimodal distributions and real datasets.
New geometric analysis of PWSPDs balances density and geometry in high-dimensional data.
problem Balancing density and geometry in high-dimensional data.
method Power-weighted shortest-path distances (PWSPDs) and their geometric and computational analyses.
result High probability guarantees on the equivalence of PWSPDs on complete and nearest neighbor graphs.
Paper learns skill distributions from game outcomes, proving minimax optimality.
problem Learning skill distributions from noisy pairwise game outcomes.
method Proposes a simple algorithm using kernel density estimation and minimax techniques.
result Near-optimal minimax mean squared error scaling for skill density estimation.
A new method for density estimation using mixture discrepancy and moments.
problem Generalizing histogram statistics to higher dimensions.
method Density estimation via mixture discrepancy and moments (DSP-mix and MSP).
result DSP-mix and MSP are computationally tractable and maintain accuracy with increased speed.
Fast AutoAugment speeds up data augmentation search.
problem Efficiently searching for effective data augmentation policies.
method Density matching-based search strategy.
result Comparable performance with faster search time.
Paper improves language models' ability to predict numbers.
problem Improving language models' numeracy for technical documents.
method Exploring memorisation, digit-by-digit composition, and a continuous probability density function model.
result Hierarchical models improve perplexity by 2 and 4 orders of magnitude.