Theory explains how noise affects learning in linear DAEs.
problem Understanding how noise influences learning in DAEs.
method Developed theory for linear DAEs, derived analytic expressions, verified with simulations and experiments.
result Noise allows DAEs to ignore low variance directions in inputs while reconstructing them.
This work extracts stochastic dynamical systems with α-stable Lévy noise.
problem Extracting data-driven governing laws of dynamical systems with non-Gaussian noise.
method End-to-end deep learning approach for learning drift and diffusion coefficients for α-stable Lévy noise. result Effectiveness of the method confirmed by numerical experiments.
Noise Injection probes deep learning dynamics during training phases.
problem Understanding the learning mechanism of deep neural networks.
method Noise Injection Nodes (NINs) are used to perturb DNN architectures without altering the optimization algorithm.
result Distinct training phases are observed based on the scale of injected noise.
Identifies most probable flows for Kunita SDEs in fluid dynamics.
problem Modeling stochastic processes with Eulerian noise and deterministic drifts.
method Equipping the domain with a Riemannian metric from the noise, solving the resulting PDEs.
result Most probable flows differ from deterministic flows, especially under noise.
Anisotropic noise helps SGD escape from sharp minima and improve generalization.
problem Understanding and improving the behavior of SGD in deep learning.
method General optimization dynamics with unbiased noise, analyzing the efficiency of noise alignment and curvature.
result Anisotropic noise in SGD helps escape from sharp minima and leads to better generalization.
Study shows how noise can ensure solutions to fluid dynamics equations.
problem Ensuring unique solutions to stochastic fluid dynamics equations.
method Extended existing results to linear advection of k-forms, proving existence and uniqueness of weak L^p-solutions.
result Proved existence and uniqueness of weak L^p-solutions to stochastic linear advection equation of k-forms.
Study of SGD with state-dependent noise, improving escape from local minima.
problem Understanding and improving the dynamics of SGD in non-convex optimization.
method Formal study on SGD with state-dependent noise, proposing power-law dynamic with state-dependent diffusion.
result Power-law dynamic can escape from sharp minima exponentially faster than flat minima.
SGD in DLNs reveals feature learning dynamics.
problem Understanding SGD dynamics in DLNs during saddle-to-saddle training.
method Stochastic Langevin dynamics with anisotropic, state-dependent noise; one-dimensional per-mode SDEs; Boltzmann distribution approximation.
result SGD noise encodes feature learning progression but does not alter saddle-to-saddle dynamics.
New method identifies network dynamics and noise structure.
problem Estimating network and disturbance topologies in dynamic systems.
method Extended multi-step Sequential Linear Regression and Weighted Null Space Fitting methods.
result Consistent estimation of dynamic networks with reduced computational burden.
Improved neural language models trained with dynamic noise-contrastive estimation.
problem Training large-scale language models efficiently and avoiding overfitting.
method Dynamic Noise-Contrastive Estimation (DNCE) to train neural trans-dimensional random field language models.
result DNCE reduces training cost and improves model performance on large datasets.
Proposes a differentially private bandit algorithm reducing noise over time.
problem Privacy concerns in interactive recommendation systems.
method Tree-based mechanism to add Laplace or Gaussian noise to model parameters, focusing on dynamic global sensitivity.
result Demonstrates (ε,δ)-differential privacy with reduced noise and improved regret. Develops a new method to discover stochastic systems with non-Gaussian noise.
problem Discovering governing laws from complex systems with non-Gaussian noise.
method Theoretical framework and numerical algorithm to extract stochastic differential equations with Gaussian and non-Gaussian noise.
result Demonstrated the efficacy and accuracy of the approach on various systems.
Improved noise estimation in latent neural SDEs enhances model accuracy.
problem Latent neural SDEs underestimate noise, limiting their stochastic dynamics modeling.
method Explicit additional noise regularization in the loss function.
result Model accurately captures diffusion component of stochastic time series data.
Improved robust latent variable estimation for neural dynamics.
problem Inconsistent results due to noise and nonlinearity in existing models.
method Probabilistic approach to latent variable estimation in decomposed models.
result More accurate latent variable inference in nonlinear systems with diverse noise conditions.
Locally private algorithm improves online federated learning with correlated noise.
problem Privacy-preserving online federated learning with non-IID data.
method Locally differentially private algorithm using temporally correlated noise.
result Established dynamic regret bound for nonconvex loss functions.
Improved SINDy autoencoder for identifying noisy dynamical systems.
problem Robust identification of noisy dynamical systems from data.
method Incorporates noise-separating neural network structures into SINDy autoencoder architecture.
result Accurately recovers latent dynamics and estimates measurement noise from noisy observations.
Method extracts stochastic systems with Lévy noise from data.
problem Identifying stochastic dynamical systems with Lévy noise from short data.
method Estimate Lévy jump measure and noise intensity, approximate drift coefficient.
result Accurate and effective method for discovering stochastic laws.
Factor analysis improves PET image interpretation by considering non-standard noise distributions.
problem Improving interpretation of dynamic PET images with non-standard noise distributions.
method Proposes using β-divergence to fit factor models for different noise distributions. result Improves factor analysis results for various noise types in PET images.
Volatility dynamics of wavelet - filtered stock price time series is studied. Using the universal thresholding method of wavelet filtering and a principle of minimal linear autocorrelation of noise component we find that the quantitative characteristics of volatility dynamics of denoised series are noticeably different…
The paper explores how symmetries and noise in SGD influence parameter dynamics.
problem Understanding the dynamics of parameter updates in SGD with symmetries.
method Proved the existence of noise equilibria and showed their role in balancing gradient noise.
result Gradient noise creates a systematic motion of parameters to a unique fixed point, called noise equilibria.
MANGA transfers policies across environments with varying dynamics and noise.
problem Transferring policies across multiple environments with different dynamics and motor noise.
method Decouples policy learning from system identification, trains dynamics-conditioned policies, and learns dynamics parameters from rollouts.
result Demonstrates effective transfer of learned policies across four MuJoCo agents using agnostic RL and imitation learning methods.
Study evaluates manifold alignment methods for noisy double pendulum dynamics.
problem Aligning manifolds of double pendulum dynamics under noise.
method Compared four manifold alignment methods: semi-supervised feature-level global and local.
result Local alignment methods were more robust to noise and faster.
GNIs induce asymmetric heavy-tailed noise in SGD, affecting network performance.
problem The effect of Gaussian noise injections on SGD dynamics and network performance.
method Developed a Langevin-like SDE driven by asymmetric heavy-tailed noise to model the modified SGD dynamics.
result GNIs induce an implicit bias that varies with noise heaviness and asymmetry, affecting network performance.
Study on variance estimation for dynamic regression with finite sample guarantees.
problem Variance estimation for dynamic linear regression with non-constant observation operator.
method Analysis of the system operator's spectrum to derive variance estimators with finite sample complexity guarantees.
result First known variance estimators with finite sample complexity guarantees for dynamic regression.
Noise-robust Koopman operator framework for control with improved stability and performance.
problem Developing a stable and noise-robust Koopman operator for control tasks.
method Proposes a learning framework using Hankel matrix and neural network approximations for system dynamics, ensuring long-term stability and noise robustness.
result Demonstrates improved model performance and noise robustness in control tasks compared to existing methods.
Detects anomalies in noisy data from linear systems.
problem Identifying samples of noise in a linear dynamical system.
method Robust spectral filtering and anomaly detection method.
result Guaranteed statistical performance in identifying noise samples.
Improves state space models' resistance to noise.
problem State space models' initialization assumes noise-free data, which is often violated.
method Uncertainty-aware initialization for state space models, reformulating HiPPO with measurement noise.
result Improves model resistance to noise at training and inference time.
Study optimizes resource allocation in noisy systems for better control.
problem Limited attention in stochastic systems with multiplicative noise.
method Analytical and numerical methods for optimal attention allocation.
result Effective resource allocation enhances noise estimation and control decisions.
New method for certified unlearning reduces noise injection.
problem Achieving formal unlearning guarantees with adaptive noise calibration.
method Adaptive per-instance noise calibration based on individual data point sensitivities.
result Derivation of high-probability per-instance sensitivity bounds for ridge regression.
Study on Langevin dynamics for recovering planted signals in spiked matrix models.
problem Recovering a planted signal in spiked matrix models.
method Path-wise characterization of overlap using integro-differential equations and explicit formula derivation.
result Sharp phase transition in limiting overlap: positive in one regime, zero in another due to injected noise.
New method learns SDEs with structured noise from data.
problem Learning SDEs with structured noise from data.
method Nonparametric framework for drift and diffusion terms.
result Accurately infers low-dimensional interaction kernels.
The paper shows how label noise in training can lead to solutions that solve a Lasso program.
problem Understanding the implicit bias of training algorithms in overparametrised models.
method Analyzing the continuous time version of the training dynamics of a quadratically parametrised model.
result The stochastic flow implicitly solves a Lasso program, providing convergence guarantees and support recovery conditions.
A new pricing strategy learns customer valuations without noise distribution knowledge.
problem Setting optimal prices for products based on customer valuations with unknown noise.
method Developed a novel perturbed linear bandit framework to learn both contextual functions and market noise.
result Proved sub-linear regret bound and demonstrated superior performance on simulations and real data.
Adaptively preconditions SGLD for faster convergence and better generalization.
problem Pathological curvature in deep network loss landscapes.
method Adaptive estimation of noise parameters to precondition isotropic gradient noise.
result Adaptively preconditioned SGLD achieves faster convergence and generalization equivalent of SGD.
SINDy-PI robustly identifies implicit dynamics from noisy data.
problem Accurately modeling nonlinear dynamics from noisy data.
method Parallel, implicit SINDy algorithm with multiple optimization algorithms and model selection.
result Significantly more noise robust than previous SINDy approaches.
Optimal dynamic fees found for AMMs to deter arbitrageurs and attract noise traders.
problem Optimizing fees in AMMs to balance against arbitrage and noise trading.
method Approximate closed-form solutions to control problem, study of fee structure.
result Two distinct fee regimes identified: high fees to deter arbitrage, low fees to attract noise traders.
New method for Bayesian learning on large datasets using replica-exchange Nosé-Hoover dynamics.
problem Bayesian learning on complex posterior distributions with multiple isolated modes and mini-batch noise.
method Simulating replicas in parallel with different temperatures, applying Nosé-Hoover dynamics, and developing a noise-aware exchange protocol.
result Significant improvements over strong baselines in deep Bayesian neural networks on large-scale datasets.
Empirical mode modeling improves state-space analysis of noisy data.
problem Analyzing nonlinear systems with noisy data.
method Combining empirical mode decomposition with empirical dynamic modeling.
result Empirical mode modeling enhances state-space representations in noisy data.
Researchers develop methods to learn neuron dynamics from colored noise.
problem Learning nonlocal stochastic neuron dynamics from colored noise.
method Proposed two methods for closing Fokker-Planck equations: nonlocal large-eddy-diffusivity closure and data-driven sparse regression.
result Mutual information and total correlation between stimulus and neuron states calculated for FHN neuron.
Proposes a new method to handle noisy labels without needing accurate noise transition estimation.
problem Learning with noisy labels in the presence of class-conditional noise.
method Introduces a Latent Class-Conditional Noise (LCCN) model that embeds noise transition in a Bayesian framework and iteratively infers latent labels.
result Demonstrates superior performance compared to state-of-the-art methods on various noisy label datasets.
The log-periodic power law (LPPL) is a model of asset prices during endogenous bubbles. A major open issue is to verify the presence of LPPL in price sequences and to estimate the LPPL parameters. Estimation is complicated by the fact that daily LPPL returns are typically orders of magnitude smaller than measured price…
Enhances network intrusion detection in noisy data.
problem Robustness against contaminated and noisy data inputs in network intrusion detection.
method Probabilistic Temporal Graph Network Support Vector Data Description (TGN-SVDD) model.
result Significant improvements in detection performance with synthetic noise.
We study the dynamics of a version of the batch minority game, with random external information and with different types of inhomogeneous decision noise (additive and multiplicative), using generating functional techniques à la De Dominicis. The control parameters in this model are the ratio α=p/N of the number p o…
SGLD improves sampling for Bayesian models on large datasets.
problem Poor convergence and mixing times in SGLD for models with scale and correlation variations.
method Preconditioning noise vector, comparing normalization approaches.
result Preconditioning improves mixing times and regularization effects.
DynaCor detects noisy labels by learning from corrupted training signals.
problem Label noise in real-world datasets hinders model generalization.
method DynaCor introduces label corruption to indirectly simulate noisy labels and learns to distinguish clean from noisy instances.
result DynaCor outperforms state-of-the-art competitors in noisy label detection.
Two models incorporate market microstructure noise into asset pricing and option valuation.
problem Effect of market microstructure noise on asset pricing and option valuation.
method Developed two models: a continuous-time Black-Scholes-Merton model and a discrete binomial tree model.
result Extracted coefficients to quantify noise impact on volatility and drift.
Study of accelerated dynamics for convex function minimization with noisy gradients.
problem Minimizing smooth convex functions with noisy gradients.
method Formulate and study continuous-time stochastic dynamics, prove convergence rates.
result Derive estimates of convergence rates for function values, both persistent and asymptotic.
This paper develops nudging algorithms using learned surrogates for state estimation in dynamical systems.
problem Estimating the state of a dynamical system from partial observations when dynamics are unknown or expensive to simulate.
method Unified finite-dimensional analysis of nudging algorithms employing learned surrogate models of the dynamics.
result Nudging algorithms with surrogate models retain exponential convergence up to an explicit error floor.