Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

162324486648 · Jun 202019922001200920172026
48 results for range density estimation

Paper develops estimators for unbounded density ratios with applications in error control.

problem Estimating density ratios with unbounded domains and ranges.
method Least squares and logistic regression loss functions for density ratio estimation.
result Established upper bounds on estimation errors with optimal rates for unbounded density ratios.

Optimizes kernel density ratios for better predictions and information measures.

problem Improving accuracy of kernel density estimates for density ratios.
method Derives an optimal weight function using calculus of variations.
result Reduces bias in kernel density estimates, leading to improved prediction posteriors and information-theoretic measures.

Autoregressive models are among the best performing neural density estimators. We describe an approach for increasing the flexibility of an autoregressive model, based on modelling the random numbers that the model uses internally when generating data. By constructing a stack of autoregressive models, each modelling th…

2017-05-19abs ↗pdf ↗

Given iidiid observations from an unknown absolute continuous distribution defined on some domain ΩΩ, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function. Our density estimate is a piecewise constant function defined on a binary partition o…

2014-04-05abs ↗pdf ↗

Study minimax rates for density estimation under Huber contamination and Besov IPM losses.

problem Minimax convergence rates of nonparametric density estimation under Huber contamination model with outliers.
method Re-scaled thresholding wavelet series estimator and GAN architectures.
result Achieves minimax optimal convergence rates under Besov IPM losses.

Machine learning models, especially based on deep architectures are used in everyday applications ranging from self driving cars to medical diagnostics. It has been shown that such models are dangerously susceptible to adversarial samples, indistinguishable from real samples to human eye, adversarial samples lead to in…

2017-05-05abs ↗pdf ↗

M-flows learn data manifolds and densities, improving manifold learning and inference.

problem Representing datasets with manifold structure more faithfully.
method Combining normalizing flows, GANs, autoencoders, and energy-based models, with a new training algorithm.
result M-flows learn data manifolds better than standard flows and provide handles for dimensionality reduction.

We present a first procedure that can estimate -- with statistical consistency guarantees -- any local-maxima of a density, under benign distributional conditions. The procedure estimates all such local maxima, or modal-sets\textit{modal-sets}, of any bounded shape or dimension, including usual point-modes. In practice, modal-…

2016-06-13abs ↗pdf ↗

This work introduces a protocol to automatically select the correct range of scales for meaningful Intrinsic Dimension estimation.

problem The Intrinsic Dimension (ID) varies with scale in real-world datasets, leading to erroneous results.
method The protocol selects the correct range of scales by ensuring constant density of data points.
result The method provides a robust and scale-adaptive approach to estimating meaningful Intrinsic Dimension.

How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators. However, existing methods are limited to a narrow range of proposal distributions or r…

2019-05-17abs ↗pdf ↗

Density estimation is a versatile technique underlying many data mining tasks and techniques,ranging from exploration and presentation of static data, to probabilistic classification, or identifying changes or irregularities in streaming data. With the pervasiveness of embedded systems and digitisation, this latter typ…

2019-06-03abs ↗pdf ↗

A new model simulates non-linear adsorption using Gaussian KDEs.

problem Simulating non-linear adsorption processes in porous materials.
method Combines random walk particle tracking with Gaussian Kernel Density Estimators for nonlinear modeling.
result Effective reproduction of Langmuir and Freundlich isotherms.

Autoregressive generative models consistently achieve the best results in density estimation tasks involving high dimensional data, such as images or audio. They pose density estimation as a sequence modeling task, where a recurrent neural network (RNN) models the conditional distribution over the next element conditio…

2017-12-28abs ↗pdf ↗

MBORE optimizes multi-objective problems using density-ratio estimation.

problem Optimizing complex, multi-objective functions with expensive evaluations.
method Extends BORE to multi-objective Bayesian optimisation, using density-ratio estimation.
result MBORE outperforms BO on high-dimensional and real-world problems.

Mixture models are powerful statistical models used in many applications ranging from density estimation to clustering and classification. When dealing with mixture models, there are many issues that the experimenter should be aware of and needs to solve. The MixEst toolbox is a powerful and user-friendly package for M…

2015-07-22abs ↗pdf ↗

Kernel density matrices simplify probabilistic deep learning.

problem Representing joint probability distributions of continuous and discrete variables.
method Extending density matrices to a reproducing kernel Hilbert space.
result Versatile representation for marginal and joint probability distributions.

Kernel density estimation (KDE) is a popular statistical technique for estimating the underlying density distribution with minimal assumptions. Although they can be shown to achieve asymptotic estimation optimality for any input distribution, cross-validating for an optimal parameter requires significant computation do…

2011-02-14abs ↗pdf ↗

A probability density function (pdf) encodes the entire stochastic knowledge about data distribution, where data may represent stochastic observations in robotics, transition state pairs in reinforcement learning or any other empirically acquired modality. Inferring data pdf is of prime importance, allowing to analyze …

2018-07-27abs ↗pdf ↗

Pathfinder uses quasi-Newton optimization for variational inference.

problem Approximating complex posterior distributions efficiently.
method Pathfinder combines quasi-Newton optimization with variational methods to approximate log densities.
result Pathfinder produces draws with lower KL divergence than ADVI and comparable to HMC, requiring fewer evaluations.

The paper studies knot densities under various constraints and degenerations.

problem Understanding knot densities under different constraints and their degenerations.
method Introduces and analyzes unconstrained and ropelength-windowed pp-densities of knot types.
result The degenerations in the unconstrained theory and the introduction of ropelength-windowed densities.

Improved flow-based models capture dependencies better with multi-scale autoregressive priors.

problem Limited expressiveness of flow-based models for long-range data dependencies.
method Introducing channel-wise dependencies through multi-scale autoregressive priors (mAR) in split coupling flow layers (mAR-SCF).
result Achieves state-of-the-art density estimation results on MNIST, CIFAR-10, and ImageNet.

This research improves demand forecasting by predicting complete probability density functions using machine learning.

problem Forecasting complete probability density functions for better operational decision making.
method Supervised machine learning method 'Cyclic Boosting' for explainable predictions.
result Predicted probability density functions are fully explainable and avoid 'black-box' models.

The COS method for European options pricing is improved with a new bound for the number of terms.

problem Determining the optimal number of terms in the COS method for accurate European option pricing.
method Using Fourier-cosine expansion, the study finds an explicit bound for the number of terms N in the cosine series approximation.
result The COS method achieves exponential convergence when the log-return density is smooth, but not when it has heavy tails.

A new distance metric derived from information theory and estimation theory.

problem Developing a robust distance metric for complex signal distributions.
method Information-Estimation Metric (IEM) derived from continuous probability density and denoising errors.
result The IEM is a valid global distance metric that adapts to the geometry of complex distributions.

Many sequence-to-sequence generation tasks, including machine translation and text-to-speech, can be posed as estimating the density of the output y given the input x: p(y|x). Given this interpretation, it is natural to evaluate sequence-to-sequence models using conditional log-likelihood on a test set. However, the go…

2020-02-17abs ↗pdf ↗

WS-KDE provides robust confidence bounds for stochastic functions.

problem Optimizing time-consuming black-box functions with stochastic outputs.
method Wilson Score Kernel Density Estimation (WS-KDE) for Bayesian optimization.
result WS-KDE provides reliable confidence bounds for any stochastic function.

A new metric evaluates generative models by comparing real and generated samples.

problem Evaluating the quality of generative models.
method Relative Density Ratio (RDR) function, optimization on variational form of φ-divergence.
result The RDR function provides a clear, interpretable, and numerically stable evaluation metric.

A new method for learning conditional distributions using ODEs and neural networks.

problem Learning conditional distributions efficiently and accurately.
method Conditional Föllmer Flow, discretized with Euler's method, using nonparametric velocity estimation.
result Effective approximation of target conditional distributions, with convergence results for Wasserstein-2 distance.

The paper proposes a method to estimate latent structures in multivariate data without assuming their existence.

problem Estimating latent structures in multivariate distributions that are difficult to identify and reflect the data generating mechanism.
method A model-free approach using a multiscale nonparametric maximum likelihood estimator.
result The method captures meaningful discrete structure at different scales and integrates them to yield an interpretable discrete representation.

New geometric analysis of PWSPDs balances density and geometry in high-dimensional data.

problem Balancing density and geometry in high-dimensional data.
method Power-weighted shortest-path distances (PWSPDs) and their geometric and computational analyses.
result High probability guarantees on the equivalence of PWSPDs on complete and nearest neighbor graphs.

We study the task of unsupervised domain adaptation, where no labeled data from the target domain is provided during training time. To deal with the potential discrepancy between the source and target distributions, both in features and labels, we exploit a copula-based regression framework. The benefits of this approa…

2017-09-29abs ↗pdf ↗