Paper presents a robust Kalman filter for state estimation.
problem Robust state estimation under process and measurement noise.
method Generalized Bayesian approach to a Weighted Observation Likelihood Filter (WoLF) framework.
result Achieved robust state estimation against both process and measurement noise.
The study investigates noise effects on parameter estimation for Ornstein-Uhlenbeck processes.
problem Impact of noise on parameter fitting for Ornstein-Uhlenbeck processes.
method Proposed algorithms to distinguish between thermal and multiplicative noise.
result Effective methods to estimate parameters even when multiplicative noise dominates.
Real-world measurement noise in applications like robotics is often correlated in time, but we typically assume i.i.d. Gaussian noise for filtering. We propose general Gaussian Processes as a non-parametric model for correlated measurement noise that is flexible enough to accurately reflect correlation in time, yet sim…
Shot-Noise processes constitute a useful tool in various areas, in particular in finance. They allow to model abrupt changes in a more flexible way than processes with jumps and hence are an ideal tool for modelling stock prices, credit portfolio risk, systemic risk, or electricity markets. Here we consider a general f…
The chapter compares Gaussian process models for stochastic simulators with varying noise.
problem Modeling stochastic simulators with varying noise.
method Various Gaussian process models are compared, including input varying noise variance, non-Gaussian noise, and quantile modeling.
result Sequential design procedures are adapted for these models.
Levy processes, which have stationary independent increments, are ideal for modelling the various types of noise that can arise in communication channels. If a Levy process admits exponential moments, then there exists a parametric family of measure changes called Esscher transformations. If the parameter is replaced w…
Method selects significant spatial covariates in noisy data.
problem Identifying true spatial covariates in noisy data.
method Combines sparsity-promoting estimation with noise-robust model selection.
result Method reliably recovers true covariates under diverse noise scenarios.
Method estimates noise variance in Gaussian process regression.
problem Estimating noise variance in Gaussian process regression models.
method Reduces hyperparameter space, uses marginal likelihood function, derives bounds and asymptotes.
result Computational advantages and robustness compared to traditional methods.
This study shows how DDPM can be represented by the OU process.
problem Designing optimal noise schedules for DDPM.
method Formal equivalence between DDPM and OU process, heuristic designs based on Fisher Information.
result Fisher-Information-motivated schedule corresponds to cosine noise schedule.
FLDD improves discrete diffusion models by learning a non-Markovian noising process.
problem Efficiency and quality of discrete diffusion models in few-step generation.
method Introduces a learnable non-Markovian forward (noising) process to match the target distribution.
result FLDD produces higher quality samples in fewer steps compared to conventional discrete diffusion models.
Develops a method to model multivariate count processes with Cox processes and shot noise intensities.
problem Modeling and estimating dependent count processes using granular data.
method Multivariate Cox process with shot noise intensities, connected via Lévy copulas.
result Allows for over-dispersion, auto-correlation, and realistic features in count processes.
Deep-neural-network (DNN) based noise suppression systems yield significant improvements over conventional approaches such as spectral subtraction and non-negative matrix factorization, but do not generalize well to noise conditions they were not trained for. In comparison to DNNs, humans show remarkable noise suppress…
It has been shown that injecting noise into the neural network weights during the training process leads to a better generalization of the resulting model. Noise injection in the distributed setup is a straightforward technique and it represents a promising approach to improve the locally trained models. We investigate…
We introduce a training method for both better word representation and performance, which we call GROVER (Gradual Rumination On the Vector with maskERs). The method is to gradually and iteratively add random noises to word embeddings while training a model. GROVER first starts from conventional training process, and th…
When stock prices are observed at high frequencies, more information can be utilized in estimation of parameters of the price process. However, high-frequency data are contaminated by the market microstructure noise which causes significant bias in parameter estimation when not taken into account. We propose an estimat…
Recent work has established the equivalence between deep neural networks and Gaussian processes (GPs), resulting in so-called neural network Gaussian processes (NNGPs). The behaviour of these models depends on the initialisation of the corresponding network. In this work, we consider the impact of noise regularisation …
Paper proposes a new method for training diffusion models using Markov operators.
problem Training efficiency and accuracy in diffusion models.
method Operator-informed score matching using spectral decomposition of Markov operators.
result Improved score matching for both low and high-dimensional distributions.
Unified framework for discrete diffusion modeling with flexible noising processes.
problem Efficient modeling of large discrete state spaces with arbitrary corruption dynamics.
method Generalized Discrete Diffusion from Snapshots (GDDS) framework that supports uniformization for fast noising and snapshot-based ELBO for reverse process.
result GDDS outperforms existing discrete diffusion methods in training efficiency and generation quality.
Improves generative models by adding jump-diffusion noise.
problem Limited performance of diffusion models in generating samples from unknown distributions.
method Generalizes diffusion processes to include jump-diffusion noise, deriving closed-form generalized score functions.
result Jump-diffusion models outperform Gaussian models in specific parameter regimes.
Diffusion models generate new samples by adding and removing noise.
problem Generating new samples from data.
method Apply noise to data, reverse the process to generate new samples.
result Diffusion models can improve classifier performance on imbalanced data.
WS diffusion models handle anisotropic Gaussian noise better than conventional methods.
problem Handling anisotropic Gaussian noise in imaging inverse problems.
method Whitened Score (WS) diffusion models based on stochastic differential equations.
result WS DMs outperform conventional DMs on anisotropic Gaussian noise.
The study tackles rough noise in high-frequency financial data using fractional Brownian motion.
problem Impediments to analyzing high-frequency financial data due to noise.
method Assuming an efficient price process as a continuous Itô semimartingale, the study derives consistent estimators and confidence intervals for roughness parameters and volatilities.
result The rough noise model explains divergence rates in volatility signature plots over time and between assets.
Study examines the training process of an unsupervised learning model for detecting gravitational-wave transient noise.
problem Transient noise in gravitational-wave detector data causes instability and signal overlap.
method Unsupervised deep learning with variational autoencoder and invariant information clustering applied to the Gravity Spy dataset.
result Training process of the unsupervised learning architecture is examined and reported.
Noise can stabilize systemic risk models with uncertain robustness.
problem Understanding systemic risk in financial systems with uncertain parameters.
method Analyzing a mean-field model of systemic risk with uncertain coefficients and noise.
result Noise can induce stability in systemic risk models, contrary to intuition.
New approach to neural networks by incorporating observation noise and arbitrary prior means.
problem Misspecification on noisy data and limitations of NTK-GP equivalence.
method Introducing a regularizer for observation noise and proposing a shifted network for arbitrary prior means.
result Removes key obstacles to practical Gaussian process modeling in neural networks.
The existence of the pricing kernel is shown to imply the existence of an ambient information process that generates market filtration. This information process consists of a signal component concerning the value of the random variable X that can be interpreted as the timing of future cash demand, and an independent no…
Noise-Contrastive Estimation improves efficiency for estimating log-likelihood of complex point processes.
problem Estimating log-likelihood of complex multivariate point processes is computationally expensive.
method Noise-Contrastive Estimation adapted for multivariate point processes, with provable guarantees.
result Our method achieves similar log-likelihood with fewer evaluations and less time.
A new Bayesian optimization method using Poisson process for better noise robustness.
problem Estimating relative rankings of candidates in noisy environments.
method Poisson process-based ranking surrogate model and tailored acquisition functions.
result PoPBO framework shows lower computation costs and better robustness to noise compared to GP-BO.
New Fourier-based diffusion model improves high-frequency generation quality.
problem Diffusion models struggle with high-frequency details.
method Analyzed and modified the forward process in Fourier space to equalize noise corruption across frequencies.
result Improved generation quality for high-frequency components.
Deep neural networks (DNN)-based machine learning (ML) algorithms have recently emerged as the leading ML paradigm particularly for the task of classification due to their superior capability of learning efficiently from large datasets. The discovery of a number of well-known attacks such as dataset poisoning, adversar…
Improved Kalman filtering with hierarchical variational approach.
problem Inconsistent process covariance estimation and slow convergence speed in traditional variational Kalman filtering.
method Introducing a surrogate variable for process-noise-free state, reformulating CAVI, and sliding-window hyperparameter estimation.
result Enhanced convergence speed and superior estimation accuracy compared to existing methods.
UNHaP removes noise from physiological events using Hawkes processes.
problem Challenges in identifying true events from spurious ones in physiological signal analysis.
method UNHaP uses marked Hawkes processes to distinguish and unmix true events from noise.
result UNHaP significantly reduces false detection rates and enhances event understanding.
Gaussian processes are improved to account for input noise in earth observation.
problem Accurate error assessment in earth observation models.
method Propose a GP model that propagates input noise through the pipeline.
result Improved error representation in temperature predictions from infrared data.
Paper proposes a self-supervised method to denoise autoregressive signals with heavy-tailed noise.
problem Denoising autoregressive signals corrupted by heavy-tailed noise.
method Self-supervised learning approach without requiring full noise distribution knowledge.
result Strong denoising performance compared to baseline methods, especially for impulsive noise.
Algorithm identifies and corrects noisy labels using Gaussian process regression.
problem Detecting and correcting real-valued noisy labels from mixed data.
method Gaussian process regression with heteroscedastic noise model and leave-one-out cross-validation.
result The method can pinpoint corrupted sample points and improve regression models.
This paper studies business cycle patterns in UK sectoral output. It analyzes the distinction between white noise processes and their non-white noise counterparts in the frequency domain and further examines the associated features and patterns for the process where white noise conditions are violated. The characterist…
Generative model improves noise estimation in stochastic rotating shallow water models.
problem Improving noise estimation in stochastic partial differential equations for fluid dynamics.
method Replaced PCA with a generative model to avoid constraints on stochastic increments.
result Generative model produces better RMSE, CRPS score, and forecast rank histograms.
Noise makes learning linear thresholds hard, but algorithms can still learn near-optimal thresholds.
problem Learning linear thresholds in noisy data.
method Exploiting natural assumptions on data-generating process.
result Efficient learning of near-optimal linear thresholds is still possible with small data even in the presence of noise.
A new method learns noise characteristics for better state estimation in real-time systems.
problem Challenges in accurately estimating states due to uncertainty in process and measurement models.
method Proposes a learning-based approach with different loss functions to identify noise characteristics.
result Demonstrates improved performance in real-time vehicle state estimation.
This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over input dependent noise variance (heteroscedasticity) and input dependent signal varia…
In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations are key components of many processing pipelines. In the distributed setting, diff…
Study reveals 1/f noise in signals made from nonoverlapping rectangular pulses.
problem Analyzing 1/f noise in signals composed of nonoverlapping pulses. method Derived a general formula for power spectral density, analyzed rectangular pulse case.
result Observed pure 1/f noise until very low frequencies with long pulse durations. Extends neural network training framework to handle noise and uncertainty.
problem Handling noise and uncertainty in neural network training.
method Integrates non-zero aleatoric noise and derives posterior covariance for epistemic uncertainty.
result Derives an estimator for posterior covariance, providing a handle on epistemic uncertainty.
We construct explicitly a bridge process whose distribution, in its own filtration, is the same as the difference of two independent Poisson processes with the same intensity and its time 1 value satisfies a specific constraint. This construction allows us to show the existence of Glosten-Milgrom equilibrium and its as…
We analyze DMs using spectral methods to design effective noise schedules.
problem Lack of theoretical foundation for synthesis process decisions in DMs.
method Introduced a frequency response perspective based on Gaussianity assumption.
result Proposed a spectral transfer function to understand DM inference process.
Improves efficiency of simulators that fail to return.
problem Computational inefficiency in simulators that don't return for certain inputs.
method Trains a conditional normalizing flow to propose perturbations.
result Increased computational efficiency of simulators.
Financial correlation matrices measure the unsystematic correlations between stocks. Such information is important for risk management. The correlation matrices are known to be ``noise dressed''. We develop a new and alternative method to estimate this noise. To this end, we simulate certain time series and random matr…
Simple method improves deep classifier accuracy under noisy labels.
problem Training deep classifiers with noisy labels.
method Probabilistic approach using temperature parameterized softmax.
result Improves accuracy, log-likelihood and calibration on noisy datasets.