TAKDE optimizes kernel density estimation for real-time dynamic processes.
problem Real-time density estimation in applications like computer vision and signal processing.
method Derives asymptotic mean integrated squared error (AMISE) upper bound for 'sliding window' kernel density estimator and proposes TAKDE as a novel, theoretically optimal estimator.
result TAKDE outperforms other dynamic density estimators in terms of test log-likelihood and runtime.
Optimizes kernel density ratios for better predictions and information measures.
problem Improving accuracy of kernel density estimates for density ratios.
method Derives an optimal weight function using calculus of variations.
result Reduces bias in kernel density estimates, leading to improved prediction posteriors and information-theoretic measures.
A new model for estimating multivariate densities efficiently.
problem Estimating complex multivariate densities efficiently.
method CDO model based on kernel mean embeddings and RKHS.
result Competitive performance with neural models and Gaussian processes.
Proposes a new method for kernel density estimation using stagewise minimization and a simple dictionary.
problem Kernel density estimation with data-adaptive weighting parameters and sparse representation.
method Stagewise minimization algorithm based on U-divergence and a simple dictionary. result Develops non-asymptotic error bound for the proposed estimator.
We propose a method for nonparametric density estimation that exhibits robustness to contamination of the training sample. This method achieves robustness by combining a traditional kernel density estimator (KDE) with ideas from classical M-estimation. We interpret the KDE based on a radial, positive semi-definite ke…
Adaptive kernel density estimation improves accuracy in high dimensions.
problem Challenges in high-dimensional density estimation with traditional methods.
method Pre-training a neural network to recommend location-adaptive kernels.
result Effective density estimation in high dimensions with improved accuracy.
Kernel Density Machines learn probability densities without structural assumptions.
problem Learning probability densities under minimal assumptions.
method Kernel-based framework, agnostic to structural requirements.
result Consistency and functional central limit theorem for sample estimator.
Fixed bandwidth KDE consistently estimates densities.
problem Consistency of kernel density estimation with fixed bandwidth.
method Introducing fixed-bandwidth KDE and proving its consistency.
result Fixed bandwidth KDE consistently estimates continuous square-integrable densities.
Adaptive clustering uses kernel density estimates for split detection.
problem Cluster detection in non-parametric settings.
method Recursive algorithm using kernel density estimates for splitting and clustering.
result Finite sample guarantees, consistency, and adaptive bandwidth selection.
A genetic algorithm improves multivariate kernel density estimation.
problem Efficiently estimating multivariate kernel density functions.
method Genetic algorithm applied to subsamples of the original data.
result The genetic algorithm-based estimator performs better than traditional methods.
The paper improves boundary detection and density estimation on noisy data.
problem Detecting boundary points and estimating density on noisy data from compact manifolds.
method Doubly stochastic scaling of the Gaussian heat kernel via Sinkhorn iterations.
result The new estimates of boundary points and density outperform standard methods, especially under noise.
Paper introduces MoM-KDE for robust density estimation robust to anomalous data.
problem Density estimation robustness to anomalous data.
method Combines Kernel Density Estimation and Median-of-Means principle.
result Achieves competitive results with lower computational complexity compared to other robust estimators.
Proposes SD-KDE for density estimation using debiased kernel density with score-based adjustments.
problem Density estimation with bias in kernel density estimation.
method Adjusts data points by taking a step along the estimated score function, then applies standard KDE with modified bandwidth.
result Significantly reduces mean integrated squared error compared to standard Silverman KDE, especially with noisy score function estimates.
The paper introduces new estimators for multivariate functions using Fourier methods.
problem Estimating multivariate functions like densities and regression functions.
method Monte Carlo estimators based on the Fourier integral theorem.
result Established rates of convergence for new estimators, often superior to existing methods.
This paper improves coreset construction for kernel density estimates.
problem Approximating large kernel density estimates with smaller ones.
method Developed a coreset construction algorithm called kernel herding.
result Approximates kernel density estimates with much smaller point sets.
Paper addresses bias in kernel density estimation under minimal assumptions.
problem Kernel density estimation bias under minimal assumptions.
method Demonstrates the need for a balance between kernel decay and bandwidth eigenvalues, and rigorously derives bias bounds.
result Explicit constants and rigorous derivation of bias bounds under minimal assumptions.
The paper provides consistency results for KDE on manifolds with irregular kernels.
problem Analyzing density estimation on manifolds with complex kernels.
method Strong uniform consistency with rates for KDE on Riemannian manifolds with Riemann integrable kernels.
result Strong uniform consistency with rates for KDE on manifolds.
Flow Matching improves statistical guarantees through kernel density estimation.
problem Improving statistical guarantees for generative models.
method Connecting Flow Matching to kernel density estimation and verifying optimal rates of convergence.
result Flow Matching achieves optimal rates up to logarithmic factors for large networks and on lower-dimensional manifolds.
LGKDE learns graph density using neural networks and perturbations.
problem Graph density estimation challenges in capturing structural patterns and semantic variations.
method LGKDE uses graph neural networks to represent graphs as discrete distributions and learns graph metrics via maximum mean discrepancy.
result LGKDE outperforms state-of-the-art baselines in graph anomaly detection.
In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or O(n*log(n)) for constructing a classifier, where n is the number of sampling instances.…
Neural-Kernelized method estimates conditional densities without parametric assumptions.
problem Estimating conditional densities on large datasets with neural networks.
method Score matching with neural networks and neural-kernelized approach.
result Consistent in conditional density estimation, compares favorably with existing methods.
Quantum method improves neural density estimation in high dimensions.
problem High-dimensional density estimation with poor performance and high computational complexity.
method Adaptive Fourier features based on quantum density matrices, integrated with neural networks.
result Competitive performance compared to state-of-the-art methods in various datasets.
Paper introduces a fast density estimator for efficient outlying aspects mining.
problem Efficiently searching for feature subsets that describe how a query stands out from a dataset.
method Proposes a simple and efficient density estimator that replaces the kernel density estimator in existing outlying aspects miners.
result The new density estimator enables systematic search of large datasets with thousands of dimensions.
This paper proposes a new method for automatically selecting the optimal kernel bandwidth in density estimation.
problem The challenge of selecting the optimal kernel bandwidth in unsupervised density estimation.
method The approach uses a topology-based loss function for automated bandwidth selection.
result Demonstrates the potential of the topology-based approach across different dimensions.
The ratio of two probability densities can be used for solving various machine learning tasks such as covariate shift adaptation (importance sampling), outlier detection (likelihood-ratio test), and feature selection (mutual information). Recently, several methods of directly estimating the density ratio have been deve…
This paper introduces a probability density estimator based on Green's function identities. A density model is constructed under the sole assumption that the probability density is differentiable. The method is implemented as a binary likelihood estimator for classification purposes, so issues such as mis-modeling and …
We study the density estimation problem with observations generated by certain dynamical systems that admit a unique underlying invariant Lebesgue density. Observations drawn from dynamical systems are not independent and moreover, usual mixing concepts may not be appropriate for measuring the dependence among these ob…
Study finds the number of modes in Gaussian kernel density estimators scales with sqrt(β log β).
problem Determining the number of clusters in Transformers.
method Used Kac-Rice formula and Edgeworth expansion to prove scaling.
result The expected number of modes scales as Θ(√(β log β)).
Efficient clustering in high dimensions with Quick Shift and LSH.
problem Density-based clustering in high-dimensional data.
method Combines Quick Shift and LSH for efficient density estimation.
result Achieves almost linear time complexity for consistency.
LLMs learn probability density functions in-context, showing distinct learning trajectories.
problem Density estimation of time series data in LLMs.
method Intensive Principal Component Analysis (InPCA) to visualize and analyze LLMs' learning dynamics.
result LLMs follow similar learning trajectories in a low-dimensional InPCA space, distinct from traditional methods.
We create efficient coresets for kernel density estimates.
problem Efficiently summarize kernel density estimates for large datasets.
method Construct polynomial-time coresets of size O(sqrt(d)/ε√log(1/ε)) for kernel density estimates.
result Near-optimal coresets with polynomial dependence on 1/ε and logarithmic dependence on 1/ε.
New method combines strengths of two PCL approaches without density ratio estimation.
problem Estimating causal functions in Proxy Causal Learning with unobserved confounders and proxies.
method Kernel-based doubly robust estimators combining treatment and outcome bridges, density ratio-free.
result Outperforms existing methods on PCL benchmarks, including a prior doubly robust method.
Meta-learning for estimating complex conditional distributions.
problem Estimating conditional densities in multimodal distributions.
method Noise contrastive estimation with kernel mean embeddings.
result Meta-learning can share representations across tasks for conditional density estimation.
Stochastic volatility modelling of financial processes has become increasingly popular. The proposed models usually contain a stationary volatility process. We will motivate and review several nonparametric methods for estimation of the density of the volatility process. Both models based on discretely sampled continuo…
Study detects P-type bifurcations in single system realizations using unreliable kernel density estimates.
problem Detecting P-type bifurcations in signals with unreliable kernel density estimates.
method Create persistence diagrams from single system realization, statistically analyze resulting set, compare point process modeling methods.
result Subsampling outperforms other point process modeling methods in predicting P-type bifurcations.
Kernel smoothing on unknown manifolds with bounds and asymptotic normality.
problem Data on unknown manifolds without boundaries.
method Finite sample bounds and asymptotic normality for kernel smoothing and its derivatives.
result Established finite sample bounds and asymptotic normality for kernel smoothing.
Optimizes sliding window approach for tracking Gaussian densities.
problem Improving tracking performance of Gaussian density estimation.
method Theoretical analysis of sliding window Gaussian Kernel Density Estimators.
result Empirical evidence shows improved tracking performance with optimal weight sequence.
New method resolves density ratio estimation saturation issues.
problem Error saturation in density ratio estimation methods.
method Iterated regularization to improve kernel methods.
result Achieves fast error rates on regular learning problems.
Kernel mixture network estimates complex conditional densities.
problem Nonparametric estimation of complex conditional densities.
method Neural network with kernel mixture model.
result Kernel mixture network outperforms existing methods in filtering and generative modeling.
A new method selects a representative subsample for efficient kernel density estimation.
problem Selecting a representative subsample without model assumptions.
method Optimal transport techniques for model-free subsampling with an efficient algorithm.
result The selected subsample can be used for efficient density estimation with derived convergence rates and optimal bandwidth.
Proposes a new method for high-dimensional density estimation.
problem Estimating high-dimensional probability density functions efficiently.
method Tensorizing flow method combining tensor-train and flow-based generative modeling.
result Efficiently constructs an approximate density in tensor-train form and trains a flow model to match empirical distribution.
Study guarantees convergence of mean shift mode estimation.
problem Ensuring reliable mode estimation in KDE using mean shift.
method Utilizes Łojasiewicz inequality to prove convergence rate.
result Extends convergence guarantees to biweight kernel.
A new method for density estimation using nearest neighbor Dirichlet mixtures.
problem Slow and unstable Bayesian density estimation methods.
method Nearest neighbor grouping, local Bayesian parametric models, Dirichlet prior, Monte Carlo sampling.
result Effective density estimation with improved computational efficiency.
New method efficiently interpolates nonparametric density estimators.
problem Efficient evaluation of nonparametric density estimators.
method Piecewise multivariate polynomial interpolation scheme.
result New estimator with low space requirements and efficient querying.
Paper tackles privacy-preserving data density issues using deconvolution.
problem Privacy-preserving noise affects data density, leading to under/over-estimation.
method Develops deconvoluting kernel density estimators and regression models.
result Demonstrates improved accuracy in estimating heavy-hitters with locally differential data.
EnEMF uses Epanechnikov kernel for high-dimensional filtering, improving accuracy and robustness.
problem Suboptimal Gaussian mixture kernel density estimates in high-dimensional settings.
method Ensemble Epanechnikov mixture filter (EnEMF) using optimal Epanechnikov kernel.
result EnEMF reduces error per particle on high-dimensional systems like Lorenz '96.
MFRDE uses medians of forest estimators to robustly estimate densities in noisy data.
problem Robust density estimation in the presence of outliers.
method MFRDE uses pointwise median operation on forest density estimators fitted on subsampled datasets.
result MFRDE achieves robustness against all outliers while maintaining accuracy for density estimation.
Proposes a method for selecting variables in nonparametric learning using power series kernels.
problem Variable selection in nonparametric learning with power series kernels.
method Two-stage estimation: consistent function approximation followed by l1-type penalized variable selection.
result The method achieves variable selection consistency for power series kernels.