DISTANA predicts and denoises spatial wave dynamics.
problem Identifying causality in spatially distributed, non-linear dynamical processes.
method Generative, recurrent graph convolution neural network architecture (DISTANA).
result DISTANA outperforms alternative approaches in denoising and predicting complex spatial wave propagation.
Unified approach to denoising Markov models for efficient sampling.
problem Designing efficient sampling algorithms for complex distributions.
method Mathematical foundation using measure transport and nonequilibrium statistical mechanics.
result Unified variational objective and backward generator construction.
New techniques improve the accuracy of identifying nonlinear systems from noisy data.
problem Identifying nonlinear dynamical systems from noisy state measurements.
method Comparative study of local and global smoothing techniques to denoise state measurements and improve sparse regression methods.
result Global smoothing methods outperform local methods in improving the accuracy of governing equation recovery.
Diffusion models improve creativity by smoothing the score function, leading to interpolated data.
problem Improving creativity in diffusion models.
method Analyzing the effect of score smoothing on diffusion model dynamics.
result Score smoothing causes diffusion models to generate data that interpolate the training set.
A method to estimate high order derivatives of data distributions from samples.
problem Estimating high order derivatives of data distributions efficiently and accurately.
method Generalizing denoising score matching via Tweedie's formula to estimate higher order derivatives.
result Models trained with the proposed method can approximate second order derivatives more efficiently and accurately than via automatic differentiation.
Enhances learning of structured distributions using nonlinear denoising score matching.
problem Learning structured distributions from noisy data.
method Latent Nonlinear Denoising Score Matching (LNDSM) integrating nonlinear dynamics with VAE-based latent score matching.
result LNDSM achieves superior sample quality and variability compared to structure-agnostic methods.
The paper develops a new probabilistic framework for denoising diffusion models using free entropy and stochastic analysis.
problem Developing a mathematical framework for denoising diffusion models in noncommutative settings.
method Formulating diffusion and reverse processes governed by operator-valued stochastic dynamics, using tools from free stochastic analysis.
result Establishing an information-geometric link between entropy production, transport, and deconvolution.
High-quality image synthesis with diffusion models, achieving state-of-the-art FID score.
problem Generating high-quality images from latent variables.
method Training diffusion probabilistic models with a weighted variational bound, inspired by denoising score matching and Langevin dynamics.
result State-of-the-art FID score of 3.17 on CIFAR10 dataset.
Score matching method improves image generation quality.
problem Score matching method underperforms GANs in metrics like Fréchet Inception Distance.
method DSM-ALS with denoising and improved sampling techniques.
result Score matching methods can match GANs in image generation quality.
Denoising autoencoders (DAEs) have proven useful for unsupervised representation learning, but a thorough theoretical understanding is still lacking of how the input noise influences learning. Here we develop theory for how noise influences learning in DAEs. By focusing on linear DAEs, we are able to derive analytic ex…
Estimates drift functions in SDEs using denoising diffusion models.
problem Estimating time-homogeneous drift functions in multivariate SDEs.
method Formulates drift estimation as a denoising problem, trains a conditional diffusion model.
result Proposed estimator matches classical methods in low dimensions and remains competitive in higher dimensions.
AniDS improves molecular force field modeling by learning anisotropic noise.
problem Molecular force field modeling suffers from oversimplified assumptions about atomic motions.
method AniDS introduces anisotropic noise generation for better modeling of directional and structural variability.
result AniDS outperforms existing methods on benchmarks, achieving significant improvements in force prediction accuracy.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
Volatility dynamics of wavelet - filtered stock price time series is studied. Using the universal thresholding method of wavelet filtering and a principle of minimal linear autocorrelation of noise component we find that the quantitative characteristics of volatility dynamics of denoised series are noticeably different…
Rolling Diffusion improves video prediction by progressively corrupting frames based on their temporal position.
problem Improving video prediction accuracy by accounting for temporal dynamics.
method A sliding window denoising process that assigns more noise to frames that appear later in a sequence.
result Rolling Diffusion outperforms standard diffusion models in tasks with complex temporal dynamics.
A method for noise reduction in functional time series using FPCA.
problem Noise contamination in functional time series.
method Extending FPCA to separate signal and noise components.
result Optimal projection minimizes mean integrated squared error.
Diffusion models simulate molecular dynamics with adjustable accuracy.
problem Simulating molecular dynamics with high accuracy and efficiency.
method Diffusion models as Euler-Maruyama integrators for Langevin dynamics, learning forces from static snapshots.
result Diffusion models generate molecular trajectories with temporal correlations similar to MD simulations.
Study uses neural networks to filter financial spillovers from noise.
problem Accurately measuring spillovers in financial markets from noise.
method Neural network-based denoising of covariance matrices.
result Developed markets are net transmitters of volatility spillovers, but can become receivers during stress.
AutoEncoder smooths noisy sensor data and interpolates missing values.
problem Noisy sensor data and missing timepoints require interpolation.
method Uses AutoEncoder to denoise and interpolate data.
result AutoEncoder improves data quality and reveals dynamics.
New algorithms improve rank one signal estimation from noisy data.
problem Estimating a rank one signal matrix from corrupted data with rotationally invariant noise.
method Developed approximate message-passing algorithms exploiting eigenvalues and iterates denoisers.
result Achieves optimal asymptotic estimation error among iterative algorithms.
DualVDT improves time-series forecasting with a novel dual reparametrized structure.
problem Time-series forecasting with improved performance and analytical rigor.
method Dual reparametrized variational mechanisms on VAE, latent score based generative model, reverse time stochastic differential equation, variational ancestral sampling, KL divergence reduction.
result Advanced performance in time-series forecasting with reduced KL divergence.
FHDMs achieve optimal convergence in spherically supported data.
problem Statistical convergence properties of FHDMs for spherical data.
method FHDMs leverage random generation time and Doob's h-transform to optimize convergence rate.
result Achieve minimax optimal convergence rate in total variation for spherically supported Sobolev smooth data.
Nonparametric density deconvolution and denoising using simulation-based inference
problem Learning latent signals and their distributions in the presence of measurement noise
method Convolutional maximum mean discrepancy (convMMD) loss and likelihood-free framework
result Learn a latent generative model matching observed data distribution
Improves generative models by using heavy-tailed noise in score matching.
problem High-dimensional limitations of Gaussian noise in generative models.
method Extended DSM to generalised normal distribution, relaxed key assumptions, developed iterative noise scaling algorithm.
result Heavy-tailed DSM leads to improved generative performance.
New method for sampling from complex distributions using stochastic localization.
problem Sampling from unnormalized target densities in multi-modal distributions.
method Stochastic Localization via Iterative Posterior Sampling (SLIPS) framework.
result Approximate samples from target distribution and denoiser learned iteratively.
Cohesion uses deep Koopman operators to generate long-range forecasts of chaotic dynamics.
problem Challenges in data-driven emulation of chaotic dynamics, especially long-range skill decay.
method Generative modeling with coherent priors estimated using reduced-order models.
result Superior long-range forecasting skill on chaotic systems, including climate dynamics.
UDM reparameterization improves language model generation.
problem Mismatch between UDM training objective and denoising posterior.
method Leave-one-out denoising and absorbing state reformulation.
result Improved UDM generation through leave-one-out parameterization.
Paper compares optimal denoising methods for generative models, finding different results based on data regularity.
problem Optimizing denoising in score-based generative models for various data types.
method Comparison of full-denoising and half-denoising approaches, analyzing performance in terms of distribution distances.
result Different denoising methods perform better under different data regularity conditions.
DSPM models control noise volatility, improving financial data analysis.
problem Financial returns exhibit volatility clustering, challenging traditional models.
method DSPM uses a tempered-stable subordinator to control noise volatility, preserving kurtosis and autocorrelation.
result DSPM models accurately capture volatility clustering and noise mechanisms.
Recently, impressive denoising results have been achieved by Bayesian approaches which assume Gaussian models for the image patches. This improvement in performance can be attributed to the use of per-patch models. Unfortunately such an approach is particularly unstable for most inverse problems beyond denoising. In th…
Attention-only transformers learn from context via two stages of inference.
problem Learning from corrupted token sequences in minimal transformers.
method Two-stage empirical Bayes interpretation: kernel-weighted posterior mean and particle dynamics.
result Effective denoising without explicit noise schedules, showing posterior-mean recovery under asymptotic conditions.
Deep neural networks have been proved efficient for medical image denoising. Current training methods require both noisy and clean images. However, clean images cannot be acquired for many practical medical applications due to naturally noisy signal, such as dynamic imaging, spectral computed tomography, arterial spin …
We investigate the "compass rose" (Crack, T.F. and Ledoit, O. (1996), Journal of Finance, 51(2), pg. 751-762) patterns revealed in phase portraits (delay plots) of stock returns. The structures observed in these diagrams have been attributed mainly to price clustering and discreteness. Using wavelet based denoising, we…
Koopman Regularization learns governing equations from sparse data.
problem Learning governing equations from sparse and corrupted data.
method Constrained optimization using Koopman Eigenfunctions.
result Restores dynamics precisely with minimal assumptions.
In real-world scenarios, different features have different acquisition costs at test-time which necessitates cost-aware methods to optimize the cost and performance trade-off. This paper introduces a novel and scalable approach for cost-aware feature acquisition at test-time. The method incrementally asks for features …
A new diffusion model uses efficient conditional estimators for discrete data.
problem Efficient estimation of conditional probabilities for discrete data.
method Discrete denoising diffusion framework with sample-efficient NeurISE conditional estimation.
result The method outperforms existing approaches in various metrics on binary and scientific data.
The paper examines the sampling dynamics of diffusion models using ODEs.
problem Understanding the sampling dynamics of diffusion models.
method Careful inspection of ODE-based sampling of SDEs, revealing structures and relationships.
result Established a theoretical relationship between optimal ODE-based sampling and mean-shift algorithm.
Improved generative models learn structured data better.
problem Training score-based generative models for structured data.
method Nonlinear denoising score matching with neural control variates.
result Enhanced learning of multimodal and symmetric data.
Improved generative models using critically-damped Langevin diffusion.
problem Current score-based generative models (SGMs) use overly simplistic diffusion processes, leading to complex denoising tasks and suboptimal performance.
method Proposed a novel critically-damped Langevin diffusion (CLD) and derived a score matching objective and sampling scheme.
result CLD-based SGMs achieve superior performance in synthesis quality compared to previous methods.
This work extends diffusion models to function space for better generative modeling.
problem Limited applicability of diffusion models to functional data domains.
method Introduces Denoising Diffusion Operators (DDOs) for training diffusion models in function space.
result Demonstrates accurate function-valued generation at fixed cost.
Unified method for simultaneous denoising and clustering.
problem Clustering noisy signals.
method Sparse convex wavelet clustering with fusion and group-sparse penalties.
result Unified approach that denoises and clusters simultaneously.
DDPD separates generation into planning and denoising for improved efficiency.
problem Efficiently denoise corrupted data during generation.
method Separates generation into a planner and denoiser, selecting denoising positions based on corruption severity.
result DDPD outperforms traditional methods on language and image generation benchmarks.
We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss functions, which arise naturally for problems such as submatrix denoising, denoising wit…
Modern methods for learning over graph input data have shown the fruitfulness of accounting for relationships among elements in a collection. However, most methods that learn over set input data use only rudimentary approaches to exploit intra-collection relationships. In this work we introduce Deep Message Passing on …
Image denoising is an important pre-processing step in medical image analysis. Different algorithms have been proposed in past three decades with varying denoising performances. More recently, having outperformed all conventional methods, deep learning based models have shown a great promise. These methods are however …
Gen-CUDE is a neural network for denoising noisy channels.
problem Denoising in finite-input, general-output noisy channels.
method Unsupervised neural network trained on noisy data.
result Gen-CUDE achieves better denoising results than other methods.
Convolutional Neural Networks (CNNs) have emerged as highly successful tools for image generation, recovery, and restoration. A major contributing factor to this success is that convolutional networks impose strong prior assumptions about natural images. A surprising experiment that highlights this architectural bias t…
GDiff tackles blind denoising with Gibbs sampling and Monte Carlo inference.
problem Blind denoising of signals with unknown noise parameters.
method Gibbs Diffusion (GDiff) method that alternates sampling steps from a conditional diffusion model and a Monte Carlo sampler.
result GDiff achieves blind denoising of natural images and cosmic microwave background data.