Censoring improves energy efficiency in diffusion networks for sensor data.
problem Energy constraints in wireless sensor networks (WSNs).
method Proposes a censoring algorithm integrated with a diffusion strategy to manage energy resources.
result Simulation results demonstrate the potential benefit of integrating censoring schemes in WSNs.
Novel estimator reduces diffusion model variance.
problem High variance in score function estimation for diffusion models.
method Uses nearest neighbour samples to estimate the score function.
result Significant decrease in variance, leading to improved model performance.
We develop a maximum penalized quasi-likelihood estimator for estimating in a nonparametric way the diffusion function of a diffusion process, as an alternative to more traditional kernel-based estimators. After developing a numerical scheme for computing the maximizer of the penalized maximum quasi-likelihood function…
This paper improves diffusion models for low-dimensional data.
problem Theoretical foundations of diffusion models are lacking for low-dimensional data.
method Score approximation, estimation, and distribution recovery of diffusion models on low-dimensional data.
result Sample complexity bounds for distribution estimation using diffusion models are provided.
Estimates drift functions in SDEs using denoising diffusion models.
problem Estimating time-homogeneous drift functions in multivariate SDEs.
method Formulates drift estimation as a denoising problem, trains a conditional diffusion model.
result Proposed estimator matches classical methods in low dimensions and remains competitive in higher dimensions.
Error estimates found between SGD with momentum and Langevin diffusion.
problem Quantifying the difference between SGD with momentum and Langevin diffusion.
method Established error estimates using 1-Wasserstein and total variation distances.
result Quantitative error estimates between SGD with momentum and underdamped Langevin diffusion.
Soft Truncation improves diffusion model performance by balancing loss scales across diffusion times.
problem Inverse correlation between density estimation and sample generation in diffusion models.
method Introduces Soft Truncation, a training technique that softens the truncation hyperparameter.
result Soft Truncation achieves state-of-the-art performance on various datasets.
Develops diffusion samplers for target distributions with efficient score and density estimates.
problem Estimating scores and densities for time-varying distributions.
method Sequential Monte Carlo with diffusion paths and control variates.
result Effective samplers for time-varying distributions with theoretical guarantees and practical applications.
This work improves diffusion models by estimating the optimal loss value for better training diagnostics.
problem The optimal loss value of diffusion models is unknown and not indicative of absolute data-fitting quality.
method Derive the optimal loss in closed form and develop effective estimators, including a stochastic variant.
result Unlocking the optimal loss as a metric for diagnosing training quality of diffusion models.
A new diffusion model uses efficient conditional estimators for discrete data.
problem Efficient estimation of conditional probabilities for discrete data.
method Discrete denoising diffusion framework with sample-efficient NeurISE conditional estimation.
result The method outperforms existing approaches in various metrics on binary and scientific data.
Diffusion models achieve nearly optimal distribution estimation in various spaces.
problem Theoretical limitations of diffusion modeling for distribution estimation.
method Analysis of approximation and generalization abilities of diffusion models in Besov spaces.
result Diffusion models achieve nearly minimax optimal estimation rates in total variation and Wasserstein distances.
A new method for training diffusion models using likelihood matching.
problem Training efficient and accurate diffusion models.
method Likelihood Matching approach, quasi-likelihood approximation, score and Hessian estimation.
result Consistent matching of first two transitional moments between diffusion steps.
Study provides error estimates for approximating game options with diffusion asset prices.
problem Approximating fair prices of game options with diffusion asset prices.
method Error estimates for discrete approximations of diffusion processes, applied to game options.
result Effective tool for computing fair prices of game options in multi-asset markets.
Method infers parameters in complex diffusion processes.
problem Parameter inference in high-dimensional, non-linear diffusion processes.
method Differentiable score matching to approximate diffusion bridges, used in an importance sampler.
result Numerically stable framework for parameter inference and diffusion mean estimation.
A diffusion model estimates data manifold dimension by tracking likelihood increases.
problem Estimating the intrinsic dimension of data manifolds.
method Trained diffusion model approximates score function, revealing manifold directionality.
result Diffusion model provides an approximation of the tangent space's dimension.
New method for estimating diffusion model densities without solving flows.
problem Estimating log densities from diffusion models efficiently.
method Monte Carlo path integral estimation, avoiding flow solving.
result Significantly more scalable and efficient density estimation.
Study fast diffusion equation under Ricci flow with estimates.
problem Analyzing fast diffusion equation under Ricci flow.
method Proved Aronson-Bénilan and Li-Yau-Hamilton type estimates.
result Extended Li-Yau-Hamilton estimates to noncompact settings.
Improves image quality in generative models by estimating pixel-wise aleatoric uncertainty.
problem Lack of quantitative assessment of image quality in diffusion models.
method Estimate pixel-wise aleatoric uncertainty during sampling phase using a perturbation scheme designed for diffusion models.
result Uncertainty-guided sampling leads to better sample generation quality as shown by FID scores.
New algorithms improve robust distributed estimation in impulsive noise.
problem Robust distributed estimation in impulsive noise environments.
method Diffusion maximum correntropy criterion algorithms.
result Outperforms existing robust diffusion algorithms.
Sharp estimates for diffusion and Ricci flow on surfaces.
problem Improving estimates for diffusion and flow equations.
method Proving sharp local L^1 - L^∞ smoothing estimates.
result Sharp decay estimates for logarithmic fast diffusion equation and Ricci flow on surfaces.
FKEE estimates expectations without samples, using diffusion bridges and PINNs.
problem Estimating expectations without large sample sizes.
method Diffusion bridge models and Feynman-Kac operator approximation using PINNs.
result Significantly reduces variance and improves efficiency.
New risk bound for drift estimator in stochastic models.
problem Theoretical guarantees for drift estimation in stochastic differential equations.
method Derives an explicit risk bound using diffusion model theory.
result Explicit decomposition of risk into multiple sources of error.
New method estimates mean exit times for diffusions and PDEs.
problem Estimating mean exit times and related functionals of stopped diffusions.
method Multilevel Monte Carlo method for mean exit times and PDE solutions.
result Complexity of O ( ε − 2 ∣ log ε ∣ 3 ) O(\varepsilon^{-2}\, |\!\log \varepsilon|^3) O ( ε − 2 ∣ log ε ∣ 3 ) for ε \varepsilon ε error. New framework for discrete-state diffusion models reduces sample complexity.
problem Lack of theoretical understanding and sample complexity analysis for discrete-state diffusion models.
method Developed a principled theoretical framework, decomposing score estimation error.
result Established sample complexity bound of O ~ ( ε − 2 ) \widetilde{\mathcal{O}}(ε^{-2}) O ( ε − 2 ) . PDDS samples from unnormalized densities using iterative particle scheme.
problem Sampling from unnormalized probability densities.
method Iterative particle scheme with novel score matching loss.
result Asymptotically consistent estimates for multimodal and high-dimensional tasks.
MINDE estimates Mutual Information using neural diffusion models.
problem Estimating Mutual Information between random variables.
method Score-based diffusion models to estimate Kullback Leibler divergence.
result MINDE is more accurate than existing methods, especially for challenging distributions.
Study uses Hawkes and diffusion models to analyze stock price dynamics.
problem Analyzing volatility and price dynamics in ultra-high-frequency stock data.
method Combined symmetric Hawkes and diffusion models with maximum likelihood estimation.
result Model provides accurate volatility estimation and dynamics of parameters.
This paper improves multi-task estimation in distributed networks using APA.
problem Simultaneous estimation of multiple vectors in collaborative networks.
method Multi-task diffusion strategies based on Affine Projection Algorithm (APA).
result Improved performance in terms of convergence rate and steady state EMSE.
SM-netFusion estimates brain network atlas by considering multiple topological measures.
problem Limited BNA estimation methods that overlook topological measures and lack discriminative power.
method Supervised multi-topology network cross-diffusion framework using degree, closeness, and eigenvector centrality measures.
result SM-netFusion produces more centered and representative templates, and improves classification accuracy.
DPS uses PINNs to estimate drift in diffusion models for sampling.
problem Accurately estimating drift term in reverse SDE from unnormalized density.
method Diffusion-PINN Sampler (DPS) solves PINN for log-density of SDE marginals.
result DPS achieves convergence guarantees and accurately samples complex distributions.
Diffusion models adapt to low-dimensional structures for nonparametric density estimation.
problem High-dimensional statistical inference challenges.
method Viewing diffusion models as implicit density estimators and exploiting their low-dimensional structure.
result Achieves minimax optimal rate for total variation distance with factorizable density.
The paper uses diffusion approximations to analyze and optimize online principal component estimation.
problem Optimizing online principal component estimation from streaming data.
method Diffusion approximation tools applied to Oja's iteration for principal component analysis.
result The Oja's iteration for the top eigenvector generates a continuous-state discrete-time Markov chain over the unit sphere.
The paper develops a neural network method for estimating drift functions of diffusion processes from discrete observations.
problem Nonparametric estimation of drift function for diffusion processes from high-frequency discrete observations.
method Neural network-based estimator for drift function estimation.
result Derives a non-asymptotic convergence rate for the neural network estimator.
Develops stability conditions for estimating affine jump-diffusions.
problem Ergodicity and consistency of parameter estimation for affine jump-diffusions.
method Establishes stochastic stability conditions and ergodicity under specific conditions.
result Proves strong laws of large numbers and functional central limit theorems for additive functionals.
Study builds a classifier for diffusions with unknown diffusion but known drifts.
problem Multiclass classification of S.D.E. paths with unknown diffusion coefficient.
method Plug-in classifier using nonparametric estimators of drift and diffusion functions.
result Consistent classification procedure with rate of convergence under different assumptions.
A new method for optimizing models with categorical variables using diffusion.
problem Optimizing models with categorical variables, especially in discrete distributions.
method Introducing ReDGE, a diffusion-based soft reparameterization method for categorical distributions.
result ReDGE consistently matches or outperforms existing gradient-based methods in experiments.
PDSim simulates and estimates commodity futures prices using polynomial diffusion models.
problem Simulating and estimating commodity futures prices using polynomial diffusion models.
method Developed an R package with a Shiny app for simulation and estimation of commodity futures prices using polynomial diffusion models.
result PDSim is the only package specifically designed for the simulation and estimation of the polynomial diffusion model.
New method aligns diffusion models for inference-time properties without retraining.
problem Aligning pre-trained diffusion models for desired inference-time properties.
method Variationally stable Doob's matching for provable guidance estimation.
result Consistent estimator of guidance with non-asymptotic convergence guarantees.
New optimal rates for score estimation improve diffusion model performance.
problem Improving statistical rates for score estimation in diffusion models.
method Sharp minimax rates for score estimation of diffused distributions.
result Achieves sharp minimax rate without extraneous logarithmic terms.
InfoBridge uses diffusion bridges to estimate mutual information accurately.
problem Estimating mutual information between random variables.
method Formulated mutual information estimation as a domain transfer problem using diffusion bridge models.
result Demonstrated unbiased estimator for various data types.
Transformer with denoising diffusion improves probabilistic density estimation.
problem Estimating non-Gaussian and multimodal probability distributions for regression problems.
method Training a denoising diffusion head on top of a Transformer model.
result The model provides reasonable probability density estimation for high-dimensional inputs.
Improved LMP algorithm for better sensor network estimation in non-uniform noise.
problem Improving distributed estimation in sensor networks with non-uniform noise.
method Weighted sum of mean square error cost function and steepest-descent recursion for weight updates.
result Advantages over diffusion LMP in non-uniform noise conditions.
Improved NPE with conditional diffusions and summary networks.
problem Approximating complex posterior distributions efficiently and accurately.
method Conditional diffusions coupled with high-capacity summary networks.
result Conditional diffusions offer improved stability, accuracy, and faster training times.
Paper establishes MLE consistency for market microstructure models.
problem Estimating parameters in partially observed diffusion models.
method Tractable sufficient condition for MLE consistency based on stationary distribution.
result Maximum likelihood estimators are consistent for market microstructure parameters.
New method circumvents curse of dimensionality in Laplacian estimation.
problem High-dimensional data challenges spectral clustering and diffusion maps.
method Kernelized Laplacian estimation via reproducing kernel Hilbert space.
result Non-asymptotic statistical rates show improved performance in high dimensions.
This work sets lower bounds on the number of score queries needed for diffusion sampling.
problem Establishing information-theoretic limits on the number of score evaluations required for diffusion sampling.
method Proving lower bounds on the number of adaptive score queries needed for sampling.
result Any sampling algorithm requires at least \(\widetilde{\Omega}(\sqrt{d})\) adaptive score queries for \(d\)-dimensional distributions.
This work extends diffusion models to handle heavy-tailed targets, improving score estimation and sampling guarantees.
problem Score estimation and sampling guarantees for heavy-tailed targets in diffusion models.
method Kernel density estimation and minimax rates analysis for score estimation and sampling guarantees.
result Sharp minimax rates for score estimation and sampling guarantees for heavy-tailed targets, revealing qualitative differences between exponential and polynomial tails.
Generative framework improves causal estimation from observational data.
problem Estimating individualized treatment effects from non-randomized data.
method Importance-Weighted Diffusion Distillation (IWDD) combining diffusion models and IPW.
result IWDD achieves state-of-the-art prediction performance and significantly improves causal estimation.