We show a general relation between the spatially disjoint product of probability density functions and the sum of their Fisher information metric tensors. We then utilise this result to give a method for constructing the probability density functions for an arbitrary Riemannian Fisher information metric tensor. We note…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “continuous probability density function”
A New Type Of Upper And Lower Bounds On Right-Tail Probabilities Of Continuous Random Variablesmath.PR
New bounds on continuous random variables' right-tail probabilities.
problem Finding precise upper and lower limits for right-tail probabilities of continuous random variables.
method Developed new bounds based on PDF, first derivative, and two parameters.
result The new bounds are tight for various continuous random variables.
Paper improves language models' ability to predict numbers.
problem Improving language models' numeracy for technical documents.
method Exploring memorisation, digit-by-digit composition, and a continuous probability density function model.
result Hierarchical models improve perplexity by 2 and 4 orders of magnitude.
A new algorithm for sampling from complex distributions.
problem Sampling from high-dimensional multivariate probability densities.
method Combines kernel herding and Gibbs sampling for deterministic sampling.
result Significantly lower computation time compared to kernel herding.
Representations based on random walks can exploit discrete data distributions for clustering and classification. We extend such representations from discrete to continuous distributions. Transition probabilities are now calculated using a diffusion equation with a diffusion coefficient that inversely depends on the dat…
Introduces a Boltzmann machine with Riemann-Theta functions for continuous and discrete states.
problem Modeling continuous and discrete states in neural networks.
method Develops a Boltzmann machine with continuous visible and discrete hidden states, solving probability density and conditional expectation analytically.
result Derives a novel parametric density function involving Riemann-Theta functions and uses it as an activation function in a feedforward neural network.
RAD approach models both continuous and discrete data.
problem Flow models struggle with discrete structures in data.
method Domain partitioning with locally invertible functions for real and discrete latent variables.
result RAD approach models both continuous and discrete structures.
A continuous time random walk model for financial distributionscond-mat.stat-mech
We apply the formalism of the continuous time random walk to the study of financial data. The entire distribution of prices can be obtained once two auxiliary densities are known. These are the probability densities for the pausing time between successive jumps and the corresponding probability density for the magnitud…
Novel approach for estimating joint probability densities using tensor decompositions and dictionaries.
problem Estimating joint probability densities of mixed discrete and continuous variables.
method Low-rank tensor decomposition combined with dictionary learning.
result Better classification and lower error rates compared to existing methods.
Given observations from an unknown absolute continuous distribution defined on some domain , we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function. Our density estimate is a piecewise constant function defined on a binary partition o…
We analyze a plug-in estimator for a large class of integral functionals of one or more continuous probability densities. This class includes important families of entropy, divergence, mutual information, and their conditional versions. For densities on the -dimensional unit cube that lie in a -Hölder s…
We provide finite-sample analysis of a general framework for using k-nearest neighbor statistics to estimate functionals of a nonparametric continuous probability density, including entropies and divergences. Rather than plugging a consistent density estimate (which requires as the sample size $n \to \in…
The paper introduces flat-topped PDFs for better fitting machine learning models.
problem Improving goodness of fit in machine learning models.
method Developed a new PDF based on the Fermi-Dirac or logistic function for adaptability.
result Flat-topped PDFs enhance model simplicity and fit quality.
Conditional probabilities modeled using Riemann-Theta Boltzmann Machines.
problem Modeling conditional probabilities in Boltzmann machines.
method Deriving conditional density functions from Riemann-Theta Boltzmann machines.
result Conditional densities can be directly inferred from Riemann-Theta Boltzmann machines.
Proposes a new method for high-dimensional density estimation.
problem Estimating high-dimensional probability density functions efficiently.
method Tensorizing flow method combining tensor-train and flow-based generative modeling.
result Efficiently constructs an approximate density in tensor-train form and trains a flow model to match empirical distribution.
Method bounds tail probabilities of continuous RVs.
problem Bounding tail probabilities of continuous random variables.
method Setting continuous, positive, and strictly decreasing/increasing functions to derive upper and lower bounds.
result Provides tighter bounds than existing methods, including a novel asymptotic capacity bound for AWGN channel.
Modified lognormal distribution with flexible tails for skewed data.
problem Skewed and fat-tailed data in natural and engineering datasets.
method Developed a family of three-parameter non-Gaussian probability density functions based on generalized kappa-exponential and kappa-logarithm functions.
result Closed-form analytic expressions for statistical functions and maximum-likelihood estimation.
Unified framework for solving first passage times of diffusion processes.
problem Solving first passage times of time-homogeneous diffusion processes.
method Unified framework based on killed version potential theory and perturbation theory.
result Closed-form solutions for probability densities of level crossing problems.
iEFM trains CNF models from unnormalized densities efficiently.
problem Training generators from energy functions or unnormalized densities.
method Iterated energy-based flow matching (iEFM) with simulation-free objective.
result iEFM outperforms existing methods in probabilistic modeling.
Quantitative stability of optimal transport maps and linearization of the 2-Wasserstein spacestat.ML
Study linearizes 2-Wasserstein space using optimal transport maps.
problem Stability and linearization of the 2-Wasserstein space.
method Explicit embedding of probability measures into a Hilbert space using optimal transport maps.
result The embedding is (bi-)Hölder continuous, with stability results for optimal transport maps.
The histogram method is a powerful non-parametric approach for estimating the probability density function of a continuous variable. But the construction of a histogram, compared to the parametric approaches, demands a large number of observations to capture the underlying density function. Thus it is not suitable for …
Paper tackles learning probabilistic logic programs for continuous data.
problem Learning meaningful symbolic representations from continuous data.
method Leverages piecewise polynomial function approximation theory for density function learning.
result First steps towards inducing probabilistic logic programs for continuous data.
Generative models improve image probability estimation but lack interpretability.
problem Lack of interpretability in generative models for natural image distributions.
method Extracted explicit probability density estimates from GANs and analyzed latent representations.
result Natural image density functions are difficult to interpret.
Improved density estimation for mixed discrete-continuous data.
problem Inconsistent density estimation for mixtures of continuous and discrete data.
method Modification of existing nonparametric density estimation methods to handle mixed discrete-continuous data.
result Improved consistency and empirical performance for mixed discrete-continuous data.
New HMC framework for truncated distributions using sigmoid approximation.
problem Hamiltonian Monte Carlo struggles with truncated distributions due to discontinuities.
method Introduce sigmoid factor to approximate probability drop, smooth potential function.
result Comparable efficiency to other methods on various sampling tasks.
This work explores CS-RBFs as novel probability density functions.
problem Underexplored use of CS-RBFs in statistics and probability modeling.
method Derivation of statistical properties of CS-RBFs as univariate and conditional densities, analysis of mixture models, and introduction of an incremental learning algorithm.
result CS-RBF densities provide competitive results in likelihood and model complexity compared to Gaussian mixture models.
This paper introduces a probability density estimator based on Green's function identities. A density model is constructed under the sole assumption that the probability density is differentiable. The method is implemented as a binary likelihood estimator for classification purposes, so issues such as mis-modeling and …
New scoring rules for multivariate distributions and level sets.
problem Evaluating forecast accuracy for multivariate distributions and level sets.
method Theoretical framework for scoring rules, decomposition of multivariate scoring functions, numerical algorithm for computation.
result New scoring functions for multivariate distributions and level sets, including density and cumulative distribution level sets.
Energy-based model learns cost functions from expert demonstrations for optimal control.
problem Learning unknown cost functions from expert demonstrations for optimal control.
method Maximum likelihood estimation via analysis by synthesis, combining Langevin dynamics with optimization and cooperative learning.
result The method can learn suitable cost functions for optimal control tasks.
Recently developed techniques have made it possible to quickly learn accurate probability density functions from data in low-dimensional continuous space. In particular, mixtures of Gaussians can be fitted to data very quickly using an accelerated EM algorithm that employs multiresolution kd-trees (Moore, 1999). In thi…
Researchers study the normalizing constant of a continuous categorical distribution.
problem Understanding the normalizing constant of the continuous categorical distribution.
method Characterize numerical behavior and present theoretical and methodological advances.
result The normalizing constant can be written in closed form using elementary functions.
OPAA estimates probability densities using functional analysis.
problem Estimating probability density functions efficiently and accurately.
method OPAA uses a parallelizable algorithm based on functional analysis to estimate probability distributions.
result OPAA provides an efficient method to estimate probability density functions and normalizing weights.
Paper connects probability density cuts to graph theory eigenfunctions.
problem Developing sparse cuts for probability densities.
method Defines sparse cuts and principal eigenfunctions for probability densities, proving Cheeger and Buser inequalities.
result No such inequalities hold for prior definitions, proving new inequalities for probability densities.
Hierarchical density embeddings capture word relationships with uncertainty.
problem Capturing semantic relationships and uncertainty in word embeddings.
method Learn hierarchical representations through probability density encapsulation, using simple loss functions and distance metrics.
result State-of-the-art performance on WordNet and Hyperlex datasets.
This research improves demand forecasting by predicting complete probability density functions using machine learning.
problem Forecasting complete probability density functions for better operational decision making.
method Supervised machine learning method 'Cyclic Boosting' for explainable predictions.
result Predicted probability density functions are fully explainable and avoid 'black-box' models.
Proposes a method to estimate time-dependent probability density functions using binary classifiers.
problem Estimating time-dependent probability density functions of stochastic processes.
method Trains a time-dependent binary classifier to discriminate between realizations of a stochastic process at two nearby time instants.
result Explicitly models and accurately reconstructs complex time-dependent, multi-modal, and near-degenerate densities.
New method improves option pricing for non-smooth functions.
problem Inefficiency of Fourier techniques with non-smooth probability density functions.
method Singular Fourier-Padé (SFP) method
result Restores global spectral convergence rate and fast error convergence.
Simplified derivation and simulation of Feller Diffusion.
problem Deriving the probability density function of Feller Diffusion.
method Fourier Transform and Method of Characteristics for derivation; simulation algorithms for validation.
result Confirmation of hitting time probabilities via simulation.
Rapid and deterministic estimation of probability densities using scale-free field theoriesphysics.data-an
The question of how best to estimate a continuous probability density from finite data is an intriguing open problem at the interface of statistics and physics. Previous work has argued that this problem can be addressed in a natural way using methods from statistical field theory. Here I describe new results that allo…
New algorithm estimates semi-continuous data density using entropy maximization.
problem Estimating density functions for semi-continuous data.
method Maximum entropy principle, requiring only constraint function samples.
result Estimate has significantly less bias compared to existing methods.
VI approximates complex densities faster than classical methods.
problem Approximating complex probability densities.
method Optimization of a family of probability density functions using KL divergence.
result VI converges faster than Markov Chain Monte Carlo.
Flow-based models use ODEs to generate complex data distributions.
problem Generating high-dimensional data with complex probability distributions.
method Flow-based models use invertible mappings governed by ODEs to capture these distributions.
result Flow-based models provide exact likelihood estimation and efficient sampling.
New method uses Fokker-Planck equation for sampling and inference.
problem Intractability of evaluating probability density in practical applications.
method Reformulates Fokker-Planck equation as a particle flow method, using velocity field.
result Turns intractable density evaluation into an advantage for variational inference, kernel mean embeddings, and sequential Monte Carlo.
Paper formulates particle flow using variational inference and Fisher-Rao gradient flow.
problem Estimating posterior densities in probabilistic models.
method Variational formulation of particle flow, Fisher-Rao gradient flow, Gaussian and Gaussian mixture approximations.
result Gaussian and Gaussian mixture approximations of Fisher-Rao particle flow reduce to Exact Daum and Huang particle flow under linear Gaussian assumptions.
RNGI model bridges two probability densities on Riemannian manifolds efficiently.
problem Limited applicability of Euclidean stochastic interpolants to Riemannian manifolds.
method Introduces RNGI model interpolating between Riemannian manifold probability densities along geodesics.
result Proves temporal marginal density solves transport equation on Riemannian manifold.
Extends neural network approximation to probability measures and tree-structured data.
problem Universal approximation of functions on probability measures and tree-structured domains.
method Proof of neural network density in probability measure spaces and Cartesian products.
result Universal approximation theorem for tree-structured domains, including JSON.
Joint distributions over many variables are frequently modeled by decomposing them into products of simpler, lower-dimensional conditional distributions, such as in sparsely connected Bayesian networks. However, automatically learning such models can be very computationally expensive when there are many datapoints and …
A new method improves density ratio estimation efficiency and accuracy.
problem Density ratio estimation trade-off between quality and efficiency.
method One-step Score-based Density Ratio Estimation (OS-DRE) combining analytic and solver-free approach.
result OS-DRE offers a favorable balance between estimation quality and inference efficiency.