Study mass transport in low-diffusivity using Lagrangian coordinates.
problem Mass preserving transport of passive tracers in low-diffusivity limit.
method Lagrangian coordinates, time-averaged diffusion equation, weighted manifold structure.
result Leading order asymptotics extend to dominant nontrivial singular value in low-diffusivity limit.
Study shows how heat leaks from material sets in low diffusivity scenarios.
problem Understanding heat leakage from material sets in low diffusivity limits.
method Generalized leading-order asymptotics for time-dependent diffusion processes.
result Diffusive transport out of a material set is proportional to the surface area of the set boundary.
Study shows how diffusion models learn on low-dimensional manifolds.
problem Learning efficiency of diffusion models on manifolds.
method Analyzes denoising score matching with random feature neural networks.
result Sample complexity scales linearly with intrinsic dimension, not ambient dimension.
Study on reliability of latent reuse in diffusion models under distribution shift.
problem When can latent spaces from a source dataset be reused for a target dataset with different distributions?
method Considered a source-target setting with approximately low-dimensional datasets near different subspaces. Analyzed the target-domain score error due to principal-angle misalignment and target ambient noise.
result Latent reuse is reliable only if the source and target subspaces are close and the target ambient noise is not too amplified.
Diffusion models learn multi-modal distributions with optimal efficiency.
problem Learning high-dimensional distributions with low-dimensional multi-modal structures.
method Score-based diffusion models, focusing on subgaussian distributions within subspaces.
result Diffusion models require O ~ ( ε − k ∨ 2 ) \widetilde{O}(\varepsilon^{-k \vee 2}) O ( ε − k ∨ 2 ) samples for 1-Wasserstein ε \varepsilon ε error, improving over prior guarantees. Improved image quality in diffusion models by limiting guidance to a specific noise level range.
problem Improving image quality in diffusion models with guidance.
method Restricting guidance to a specific noise level range.
result Significantly improved FID score from 1.81 to 1.40 in ImageNet-512.
Automated denoising score matching handles nonlinear diffusion processes.
problem Nonlinear diffusion processes limit generative modeling and property estimation.
method Local-DSM using local increments and Taylor expansions.
result Tractable training and score estimation for nonlinear diffusion processes.
Recursive training of generative models can lead to model collapse, and the recursion converges to a unique limiting distribution.
problem Model collapse in recursive training of generative models
method Recursive training on their own outputs
result Recursive training converges to a unique limiting distribution
Extends neural diffusion processes for multi-task regression.
problem Limited to single-task inference, existing formulations cannot capture dependencies across related tasks.
method Introduces a task encoder to condition diffusion model on low-dimensional representations of context observations.
result Improves predictive performance and uncertainty calibration across related functions.
New method improves local precipitation predictions using video diffusion.
problem Limited high-resolution local precipitation predictions due to computational costs.
method Extends video diffusion models to capture conditional distribution of high-resolution patterns.
result Method outperforms state-of-the-art baselines in CRPS, MSE, and precipitation distribution.
Diffusion models achieve nearly optimal distribution estimation in various spaces.
problem Theoretical limitations of diffusion modeling for distribution estimation.
method Analysis of approximation and generalization abilities of diffusion models in Besov spaces.
result Diffusion models achieve nearly minimax optimal estimation rates in total variation and Wasserstein distances.
Diffusion models adapt to low-dimensional data regardless of coefficient choices.
problem Understanding how diffusion models adapt to low-dimensional data structures.
method Analysis of diffusion models with flexible coefficient choices.
result Proven that O ~ ( k / ε ) \widetilde{O}(k/\varepsilon) O ( k / ε ) iterations suffice for accurate sampling in total variation distance. A new method for generating samples without training, using smoothed score matching.
problem Generating samples efficiently and without training.
method Moment-matched score-smoothed overdamped Langevin dynamics (MM-SOLD).
result The method enables fast, robust, training-free sampling with competitive sample fidelity and diversity.
Diffusion maps are a commonly used kernel-based method for manifold learning, which can reveal intrinsic structures in data and embed them in low dimensions. However, as with most kernel methods, its implementation requires a heavy computational load, reaching up to cubic complexity in the number of data points. This l…
This paper improves diffusion models for low-dimensional data.
problem Theoretical foundations of diffusion models are lacking for low-dimensional data.
method Score approximation, estimation, and distribution recovery of diffusion models on low-dimensional data.
result Sample complexity bounds for distribution estimation using diffusion models are provided.
The paper shows diffusion models can converge faster to a target distribution with low-dimensional structure.
problem Improving the convergence rate of diffusion models to target distributions.
method Analyzing DDIM and DDPM samplers under low-dimensional structure assumptions.
result The iteration complexities of DDIM and DDPM are no greater than k / ε k/\varepsilon k / ε in total variation distance. Improves image quality in generative models by estimating pixel-wise aleatoric uncertainty.
problem Lack of quantitative assessment of image quality in diffusion models.
method Estimate pixel-wise aleatoric uncertainty during sampling phase using a perturbation scheme designed for diffusion models.
result Uncertainty-guided sampling leads to better sample generation quality as shown by FID scores.
Shallow diffusion models learn hidden low-dimensional structures effectively.
problem Learning from high-dimensional signals like images and video.
method Analysis of shallow diffusion models over the Barron space of single layer neural networks.
result Shallow diffusion models can adapt to simple low-dimensional structures, overcoming the curse of dimensionality.
HyFAD improves time series imputation by combining time and frequency diffusion.
problem Improve time series imputation by handling frequency-sensitive denoising and balancing global and local dynamics.
method HyFAD is a hybrid time-frequency diffusion model with frequency-aware embedding, built on DDPM paradigm.
result HyFAD achieves state-of-the-art performance in time series imputation.
DreamFusion uses text-to-image diffusion models to create 3D images efficiently.
problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.
Paper adapts DDPM to low-dimensional structures in image distributions.
problem Understanding and adapting to low-dimensional structures in image distributions.
method Developed a novel set of analysis tools to characterize algorithmic dynamics.
result First theoretical demonstration that DDPM can adapt to unknown low-dimensional structures.
Latent DiTs improve data distribution recovery and inference efficiency under low-dimensional latent space.
problem Improving data distribution recovery and inference efficiency in latent DiTs.
method Investigates statistical and computational limits of latent DiTs under low-dimensional latent space assumption, deriving approximation error bounds, sample complexity, and efficient inference and training algorithms.
result Latent DiTs can bypass high dimensionality challenges and achieve almost-linear time inference and training.
Diffusion models improve image compression at low bit-rates.
problem Efficiently compressing images at very low bit-rates.
method Encoding into an embedding, using diffusion models to refine the embedding iteratively.
result Realistic reconstructions can be generated at extremely low bit-rates.
Tract-specific diffusion measures, as derived from brain diffusion MRI, have been linked to white matter tract structural integrity and neurodegeneration. As a consequence, there is a large interest in the automatic segmentation of white matter tract in diffusion tensor MRI data. Methods based on the tractography are p…
Proposes a model to generate high-dimensional financial returns using latent factor structure.
problem Challenges in financial scenario simulation, especially in high-dimensional and small data settings.
method Integrates latent factor structure into generative diffusion processes, decomposing the score function using time-varying orthogonal projections.
result Establishes rigorous statistical guarantees for score estimation and generated distribution, surpassing dimension-dependent limits.
Local data coverage governs memorization in diffusion models.
problem Memorization in diffusion models
method Derive a theoretical criterion based on local data coverage
result Predicts memorization based on density of training data in neighborhood and dataset size
Diffusion models adapt to low-dimensional structures for nonparametric density estimation.
problem High-dimensional statistical inference challenges.
method Viewing diffusion models as implicit density estimators and exploiting their low-dimensional structure.
result Achieves minimax optimal rate for total variation distance with factorizable density.
Generative diffusion models gradually memorize training data, losing independent dimensions.
problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.
Paper accelerates diffusion models, improving sampling speed.
problem Low sampling speed in score-based diffusion models.
method Design of novel training-free algorithms for deterministic and stochastic samplers.
result Accelerated samplers converge faster with improved rates.
LoRAs enable efficient adaptation of large models; this paper explores processing LoRA weights with machine learning.
problem Efficient processing of low-rank weight decompositions in large finetuned models.
method Developed symmetry-aware invariant and equivariant LoL models to process LoRA weights.
result LoL models can predict CLIP scores, finetuning data attributes, and accuracy on downstream tasks.
We study the small-time fluctuations for diffusion processes which are conditioned by their initial and final positions, under the assumptions that the diffusivity has a sub-Riemannian structure and that the drift vector field lies in the span of the sub-Riemannian structure. In the case where the endpoints agree and t…
Enhanced probabilistic sampling on manifolds using Double Diffusion Maps and Geometric Harmonics.
problem Overfitting and loss of generalization in PLoM when N is small and dimensionality approaches N.
method Extending PLoM with Double Diffusion Maps and Geometric Harmonics to handle small N and high-dimensional data.
result Effective and robust method for generating statistically consistent realizations from limited data.
LSSDM improves imputation of multivariate time series data.
problem Imputation of multivariate time series data without labels.
method LSSDM projects observed data into latent space, reconstructs missing values without labels, and uses a conditional diffusion model for precise imputation.
result LSSDM achieves superior imputation performance and uncertainty analysis.
Localized diffusion models reduce training complexity by exploiting low-dimensional structure.
problem Training diffusion models is computationally expensive due to the curse of dimensionality.
method Localized neural networks and localized score matching loss to estimate low-dimensional score functions.
result Localized diffusion models can circumvent the curse of dimensionality with reduced sample complexity.
Diffusion-VAE tackles multi-step stock price prediction with stochastic noise.
problem Challenges in multi-step stock price prediction due to stochasticity and target price sequence.
method Combines hierarchical VAE and diffusion probabilistic techniques for seq2seq stock prediction.
result D-Va model outperforms state-of-the-art solutions in prediction accuracy and variance.
New method simulates sticky boundaries in multidimensional diffusions.
problem Simulating sticky boundaries in multidimensional diffusions.
method Approximate sticky diffusion by a Markov chain, using either finite difference or matching local moments.
result Validates both construction methods for first-order simulation schemes.
A new method uses string method to explore diffusion models.
problem Understanding the geometry of learned distributions in diffusion models.
method String method to compute continuous paths between samples.
result The string method identifies realistic morphing sequences and transition pathways.
Diffusion means converge to extrinsic means for long times on spheres.
problem Understanding the long-time behavior of diffusion means on manifolds.
method Introduced diffusion means as a parameterized family of location statistics on manifolds, and analyzed their convergence to extrinsic means for long times.
result For real projective spaces and connected compact symmetric spaces, the long-time limit of diffusion means is conjectured to be the extrinsic mean in the isometric embedding.
Paper proposes a new method for supervised manifold learning using random forest proximities.
problem Existing supervised manifold learning methods fail to uncover meaningful embeddings due to using class-conditional distances.
method Proposes a data-geometry-preserving variant of random forest proximities as an initialization for manifold learning methods.
result Local and global structure preservation is near universal across manifold learning approaches using diffusion-based algorithms.
A new method optimizes diffusion models with recursive likelihood ratios.
problem Efficiently aligning pre-trained diffusion models for specific applications.
method Recursive Likelihood Ratio (RLR) optimizer for Half-Order (HO) fine-tuning.
result The RLR method achieves unbiased and lower-variance gradients, improving model performance.
A new method for signal recovery in high dimensions using projections and diffusion models.
problem Recovering a latent signal from noisy observations with unknown support.
method Metric projection estimator based on score matching in a diffusion model.
result The posterior distribution concentrates near the metric projection of the observed signal.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
This work connects diffusion models to power iteration, revealing how low frequencies emerge earlier.
problem Understanding the generation process of diffusion models and their relation to power iteration.
method Examined the linear case of diffusion models, connecting them to the spiked covariance model and power iteration.
result Linear diffusion models converge to the leading eigenvector, similar to power iteration.
Diffusion models' consistency across splits explained by random matrix theory.
problem Consistency of diffusion models trained on non-overlapping subsets.
method Random matrix theory framework to quantify dataset effects on denoiser and sampling map.
result The theory explains and predicts cross-split disagreement in diffusion models.
New method reduces memorization in diffusion models without sacrificing image quality.
problem Diffusion models often memorize training data, especially with small datasets.
method Train models using noisy data at large noise scales to reduce memorization.
result Significant reduction in memorization without compromising image quality.
A hybrid model combines diffusion and neural operator methods for stress prediction in hyperelastic materials.
problem Challenges in predicting stress fields in hyperelastic materials with complex microstructures.
method A hybrid surrogate framework combining a conditional denoising diffusion probabilistic model (cDDPM) and a modified DeepONet.
result The hybrid model consistently outperforms traditional methods by one to two orders of magnitude.
DDMI generates high-quality INRs by adapting positional embeddings.
problem Existing INR generative models fail to produce high-quality representations.
method DDMI uses adaptive positional embeddings and a D2C-VAE to enhance expressive power.
result DDMI outperforms existing models across multiple modalities and datasets.
We study the limiting behaviour of the empirical measure of a system of diffusions interacting through their ranks when the number of diffusions tends to infinity. We prove that the limiting dynamics is given by a McKean-Vlasov evolution equation. Moreover, we show that in a wide range of cases the evolution of the cum…