Paper presents a new video generation model using diffusion probabilistic methods.
problem Generating high-quality video sequences.
method Denoising diffusion probabilistic models, autoregressive, end-to-end optimization.
result Significant improvements in perceptual quality and probabilistic frame forecasting.
This work combines recurrent models with diffusion for probabilistic time series forecasting.
problem Scalability and capturing high-dimensional distributions and cross-feature dependencies in time series forecasting.
method Combines recurrent neural networks' efficiency with diffusion models' probabilistic modeling, using stochastic interpolants and conditional generation.
result Offers scalable probabilistic time series forecasting methods.
A new diffusion model tackles brightness issues with a probabilistic approach.
problem Brightness-related limitations in diffusion models.
method Introduces a novel diffusion model with a probabilistic framework, modifying both forward and reverse diffusion processes.
result The model mitigates brightness-related limitations and improves performance in high-dimensional settings.
DMVI uses diffusion models for efficient probabilistic inference in PPLs.
problem Efficient probabilistic inference in complex probabilistic programming languages.
method DMVI employs diffusion models as variational approximations to the posterior distribution, optimizing a bound on the marginal likelihood.
result DMVI produces more accurate posterior inferences than existing methods in PPLs with similar computational cost and less manual tuning.
Paper presents a probabilistic framework for diffusion synchronization.
problem Improper application of heuristics leads to suboptimal results in diffusion synchronization.
method Develops a probabilistic framework to analyze and adapt correlation models for each specific task.
result Achieves better results by identifying optimal correlation models per task.
Proposes using diffusion models for probabilistic stock market predictions.
problem Uncertainties in financial data make deterministic models ineffective for stock market predictions.
method Utilizes Denoising Diffusion Probabilistic Models (DDPM) and Masked Relational Transformer (MRT).
result Achieves state-of-the-art performance in stock movement prediction and portfolio management.
ProGen improves spatiotemporal forecasting with SDEs and diffusion models.
problem Complex spatial and temporal dependencies in spatiotemporal data.
method ProGen uses Stochastic Differential Equations and diffusion-based generative models.
result ProGen outperforms state-of-the-art models on traffic datasets.
Diffusion models enhance robotic manipulation through probabilistic multi-modal learning.
problem Enhancing robotic manipulation through robust and multi-modal learning.
method Probabilistic diffusion models integrating imitation and reinforcement learning.
result Diffusion models improve grasp learning, trajectory planning, and data augmentation in robotics.
High-quality image synthesis with diffusion models, achieving state-of-the-art FID score.
problem Generating high-quality images from latent variables.
method Training diffusion probabilistic models with a weighted variational bound, inspired by denoising score matching and Langevin dynamics.
result State-of-the-art FID score of 3.17 on CIFAR10 dataset.
DYffusion improves diffusion models for spatiotemporal forecasting.
problem Challenges in generating stable and accurate forecasts for dynamic data.
method Leverages temporal dynamics in data, directly coupling it with diffusion steps.
result Improves computational efficiency and performs competitively on complex dynamics.
Grad-TTS models speech from text using diffusion probabilistic techniques.
problem Creating high-quality speech from text input.
method Score-based decoder with stochastic differential equations for noise-to-speech transformation.
result Grad-TTS produces mel-spectrograms from text input with competitive quality.
CSDI improves time series imputation by 40-65% over existing methods.
problem Imputing missing values in time series data.
method Conditional Score-based Diffusion models conditioned on observed data.
result CSDI improves by 40-65% over existing probabilistic imputation methods on popular metrics.
A new TTS method uses diffusion and VAE for better speech synthesis.
problem Improving text-to-speech synthesis for better speech quality and robustness.
method Combines diffusion probabilistic model and variational autoencoder for latent variable conversion.
result The method is robust to poor orthography and alignment errors.
SpecGrad improves neural vocoder sound quality by adapting diffusion noise to log-mel spectrogram.
problem Improving neural vocoder sound quality, especially in high-frequency bands.
method Adapting the diffusion noise distribution to the conditioning log-mel spectrogram through time-varying filtering.
result SpecGrad generates higher-fidelity speech waveform than conventional DDPM-based neural vocoders.
New model detects anomalies without needing clean data.
problem Anomaly detection without clean data.
method Robust denoising diffusion probabilistic models (RDDPM) using robust regression.
result Significantly outperforms existing methods in anomaly segmentation.
This paper improves QoS metric prediction in DTNs using diffusion models.
problem Improving QoS metric prediction in Delay-Tolerant Networks (DTNs) to enhance network performance.
method Formulates QoS metric prediction as a probabilistic forecasting problem on multivariate time series, incorporating latent temporal dynamics.
result The proposed approach outperforms traditional methods in QoS metric prediction for DTNs.
Transformer with denoising diffusion improves probabilistic density estimation.
problem Estimating non-Gaussian and multimodal probability distributions for regression problems.
method Training a denoising diffusion head on top of a Transformer model.
result The model provides reasonable probability density estimation for high-dimensional inputs.
Treeffuser predicts tabular data distributions using gradient-boosted trees.
problem Probabilistic prediction with flexible, non-parametric models.
method Gradient-boosted trees for score estimation in conditional diffusion model.
result Treeffuser outperforms existing methods in probabilistic prediction tasks.
Introduces Star-Shaped DDPMs for non-Gaussian distributions.
problem Difficulties in defining DDPMs for non-Gaussian distributions.
method Star-shaped diffusion process, duality with specific Markovian diffusions, efficient algorithms.
result SS-DDPMs can model distributions like Beta, von Mises-Fisher, Dirichlet, Wishart.
Transformers interpreted as probabilistic Laplacian Eigenmaps steps.
problem Improving transformer performance through probabilistic interpretation.
method Probabilistic Laplacian Eigenmaps model derivation and graph diffusion step.
result Subtracting identity from attention matrix improves transformer performance.
Faster diffusion-based models generate data with fewer steps.
problem Slow and costly diffusion-based generative models.
method Truncate diffusion process to generate data more efficiently.
result Truncated models provide consistent improvements in performance.
ERDM integrates rolling forecasts with diffusion models for complex dynamics.
problem Forecasting complex dynamics with rolling forecasts and diffusion models.
method Adapting EDM components for rolling forecasts, introducing novel loss weighting, efficient initialization, and hybrid architecture.
result ERDM outperforms diffusion-based baselines in 2D Navier-Stokes simulations and ERA5 weather forecasting.
A new model designs molecular latent vectors for drug discovery.
problem Designing effective molecular descriptors from molecular structures.
method Proposes a denoising diffusion probabilistic model (DDPM) for variational autoencoding molecular graphs.
result Demonstrates superior prediction performance and robustness compared to existing approaches.
LSSDM improves imputation of multivariate time series data.
problem Imputation of multivariate time series data without labels.
method LSSDM projects observed data into latent space, reconstructs missing values without labels, and uses a conditional diffusion model for precise imputation.
result LSSDM achieves superior imputation performance and uncertainty analysis.
New method calibrates DPMs to improve likelihood bounds.
problem Improving the likelihood bounds of DPMs.
method Deriving concentration bounds and using the optional stopping theorem for data scores to calibrate DPMs.
result Calibrated DPMs can increase likelihood bounds and improve sampling quality.
Residual Prior Diffusion integrates coarse latent priors with diffusion models for better generative tasks.
problem Diffusion models struggle with representing both large-scale and fine-scale details in data distributions.
method Two-stage framework: first a coarse prior model captures large-scale structure, then a diffusion model represents the residual.
result RPD accurately captures fine-scale details while preserving large-scale structure, outperforming standard diffusion models.
The paper develops a new probabilistic framework for denoising diffusion models using free entropy and stochastic analysis.
problem Developing a mathematical framework for denoising diffusion models in noncommutative settings.
method Formulating diffusion and reverse processes governed by operator-valued stochastic dynamics, using tools from free stochastic analysis.
result Establishing an information-geometric link between entropy production, transport, and deconvolution.
Enhanced probabilistic sampling on manifolds using Double Diffusion Maps and Geometric Harmonics.
problem Overfitting and loss of generalization in PLoM when N is small and dimensionality approaches N.
method Extending PLoM with Double Diffusion Maps and Geometric Harmonics to handle small N and high-dimensional data.
result Effective and robust method for generating statistically consistent realizations from limited data.
The paper analyzes the probabilistic structure of DDPMs and bounds their sampling error.
problem Understanding and controlling errors in discrete-time DDPMs.
method Structural analysis of score functions, Schrödinger's problem, and FBSDEs.
result Explicit upper bound for total variation distance between sampling and target distributions.
CW-Gen models improve probabilistic time series forecasting by incorporating prior information.
problem Challenges in probabilistic forecasting of multivariate time series due to non-stationarity, inter-variable dependencies, and distribution shifts.
method CW-Gen framework that incorporates prior information through conditional whitening. JMCE learns conditional mean and covariance, improving sample quality.
result CW-Gen consistently enhances predictive performance, capturing non-stationary dynamics and inter-variable correlations more effectively than prior-free approaches.
DIN framework directly models hydraulic conductivity and uncertainty.
problem Modeling hydraulic conductivity and uncertainty in groundwater flow.
method DIN utilizes DDPM as a prior learner, incorporating observational data through conditional injection mechanisms.
result DIN generates multiple constraint-satisfying realizations and accurate uncertainty quantification.
The Perona-Malik model has been very successful at restoring images from noisy input. In this paper, we reinterpret the Perona-Malik model in the language of Gaussian scale mixtures and derive some extensions of the model. Specifically, we show that the expectation-maximization (EM) algorithm applied to Gaussian scale …
Paper establishes fast convergence theory for diffusion models under minimal assumptions.
problem Establish theoretical guarantees for diffusion models under minimal assumptions.
method Developed a convergence theory for denoising diffusion probabilistic models (DDPM) under minimal assumptions.
result Achieved convergence rate of O(d/T) for target distributions with finite first-order moment.
Improved DDPMs achieve high log-likelihoods and sample quality with fewer passes.
problem Improving log-likelihoods of DDPMs while maintaining high sample quality.
method Modifying DDPMs with learning variances and using precision-recall metrics.
result DDPMs can achieve competitive log-likelihoods with fewer forward passes.
Equivariant diffusion model generates 3D molecules efficiently.
problem Generating high-quality 3D molecules efficiently.
method Equivariant Diffusion Model (EDM) that operates on atom coordinates and types.
result Significantly outperforms previous methods in molecule quality and training efficiency.
This note clarifies connections between Föllmer process and DDPM sampler.
problem Understanding the relationship between Föllmer process and DDPM sampler.
method Direct discretization of the Föllmer process and DDPM sampler analysis.
result Discretized Föllmer processes provide optimal hyper-parameters for DDPM samplers.
Study evaluates ensemble methods for zero-shot uncertainty quantification with diffusion models.
problem Quantifying uncertainty in zero-shot regression problems using diffusion models.
method Used diffusion probabilistic models for ensemble prediction and evaluated their effectiveness on various regression tasks.
result Ensemble methods consistently improve model prediction accuracy across different regression tasks.
DPM-Solver speeds up DPM sampling to 10-20 function evaluations.
problem Slow sampling from Diffusion Probabilistic Models (DPMs).
method Exact formulation of diffusion ODE solutions, using change-of-variable and exponentially weighted integral.
result Generates high-quality samples in 10-20 function evaluations.
Language Rectified Flow improves diffusion language generation by simplifying complex steps.
problem Complexity in diffusion language models limits their implementation in NLP applications.
method Reformulates probabilistic flow models to learn neural ODE models for efficient domain transfer.
result Consistently outperforms baselines on fine-grained control tasks and text editing.
Early stopping improves generalization in overparameterized diffusion models.
problem Understanding and optimizing generalization in overparameterized diffusion models.
method Revisiting diffusion models, showing generalization occurs before memorization, and developing a phase diagram.
result Generalization time scales with dataset size, supporting early-stopping criteria.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
DBT combines diffusion models and boosting for supervised learning.
problem Supervised learning problems.
method Diffusion Boosting paradigm and Diffusion Boosted Trees (DBT).
result DBT outperforms deep neural network-based diffusion models and is effective on real-world classification tasks.
DDPMs can reproduce medical image context, showing interpolation between samples.
problem Understanding DDPMs' ability to learn spatial context in medical imaging.
method Used stochastic context models (SCMs) to produce training data and assess DDPMs' performance.
result DDPMs can generate contextually correct images, interpolating between samples.
Paper introduces new methods for modeling categorical data.
problem Training generative models on categorical data like text and segmentation.
method Argmax Flows and Multinomial Diffusion models.
result Models outperform existing methods in log-likelihood.
Paper introduces DMPMs for efficient discrete data generation with sharp convergence bounds.
problem Efficient generation of discrete data with theoretical guarantees.
method Discrete Markov Probabilistic Models (DMPMs) operating in bit space with time-reversal process.
result Sharp convergence bounds established under minimal assumptions, competitive performance in discrete data generation.
Paper adapts DDPM to low-dimensional structures in image distributions.
problem Understanding and adapting to low-dimensional structures in image distributions.
method Developed a novel set of analysis tools to characterize algorithmic dynamics.
result First theoretical demonstration that DDPM can adapt to unknown low-dimensional structures.
Diffolio uses a diffusion model for multivariate financial forecasting and portfolio construction.
problem Probabilistic forecasting of multivariate financial time-series with complex cross-sectional dependencies.
method Diffolio employs a denoising network with hierarchical attention architecture, incorporating asset-level and market-level layers and a correlation-guided regularizer.
result Diffolio outperforms various probabilistic forecasting baselines in multivariate forecasting accuracy and portfolio performance.
New method controls classifier guidance in diffusion models.
problem Improving classifier guidance in diffusion models.
method Cross-entropy control of classifier gradients.
result Effective guidance vectors with mean squared error O(dε).