Measures three types of noise in LLM evaluations.
problem Separating signal from noise in LLM experiments.
method Defined and measured three types of noise: prediction, data, and total noise. Proposed the all-pairs paired method for statistical power.
result Total noise level is characteristic and predictable across all model pairs.
Paper presents a robust Kalman filter for state estimation.
problem Robust state estimation under process and measurement noise.
method Generalized Bayesian approach to a Weighted Observation Likelihood Filter (WoLF) framework.
result Achieved robust state estimation against both process and measurement noise.
Using recent advances in the econometrics literature, we disentangle from high frequency observations on the transaction prices of a large sample of NYSE stocks a fundamental component and a microstructure noise component. We then relate these statistical measurements of market microstructure noise to observable charac…
Real-world measurement noise in applications like robotics is often correlated in time, but we typically assume i.i.d. Gaussian noise for filtering. We propose general Gaussian Processes as a non-parametric model for correlated measurement noise that is flexible enough to accurately reflect correlation in time, yet sim…
RECLAIM discovers causal graphs in cyclic, noisy systems.
problem Discovering causal relationships in cyclic, noisy systems.
method RECLAIM uses EM with residual normalizing flows to handle cycles and noise.
result RECLAIM effectively discovers causal graphs in both synthetic and real-world datasets.
Develops efficient inference for noise heterogeneity in machine learning models.
problem Downstream procedures based on residuals can be biased in additive noise models.
method Semiparametrically efficient inference using a novel Hilbert-valued one-step estimator.
result Constructs tests and confidence intervals for residual independence and goodness of fit.
In this paper, we propose a new method of Bayesian measurement for spectral deconvolution, which regresses spectral data into the sum of unimodal basis function such as Gaussian or Lorentzian functions. Bayesian measurement is a framework for considering not only the target physical model but also the measurement model…
Financial correlation matrices measure the unsystematic correlations between stocks. Such information is important for risk management. The correlation matrices are known to be ``noise dressed''. We develop a new and alternative method to estimate this noise. To this end, we simulate certain time series and random matr…
New f-divergence measures improve robustness in noisy label learning.
problem Improving robustness in learning with noisy labels.
method Derived decoupling property of f-divergence measures under label noise. result Properly defined f-divergence measures are robust with label noise. Improved PINNs for solving PDEs with unknown measurement noise.
problem Handling non-Gaussian noise in physics-informed neural networks.
method Jointly train an EBM to learn the correct noise distribution.
result Improved performance in solving PDEs with non-Gaussian noise.
Shot-Noise processes constitute a useful tool in various areas, in particular in finance. They allow to model abrupt changes in a more flexible way than processes with jumps and hence are an ideal tool for modelling stock prices, credit portfolio risk, systemic risk, or electricity markets. Here we consider a general f…
SGLBO optimizes quantum circuits with fewer measurements, improving accuracy and noise resilience.
problem Efficiently optimizing parameterized quantum circuits with reduced measurement shots and noise.
method Developed SGLBO combining SGD and BO, with adaptive measurement-shot strategy and suffix averaging.
result Significantly reduces measurement-shot cost while improving accuracy and noise resilience.
This paper studies the classification of high-dimensional Gaussian signals from low-dimensional noisy, linear measurements. In particular, it provides upper bounds (sufficient conditions) on the number of measurements required to drive the probability of misclassification to zero in the low-noise regime, both for rando…
It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A biased measure may work well on certain data sets, but it can also be less effe…
Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant Lasso address this dependence by jointly estimating the noise level and the regressi…
The paper extends Pearson correlation to multi-variables, useful for noise measurement and feature selection.
problem The standard Pearson correlation coefficient is limited to two variables and doesn't meet the needs for multi-variable analysis.
method The authors use random matrix theory to extend Pearson's correlation coefficient to an arbitrary number of variables.
result The extended correlation coefficient is useful for gauging noise and selecting features, particularly in classification.
CWGD measures gradient diversity weighted by curvature, improving SGD convergence.
problem Gradient noise in high-curvature directions is underestimated by standard methods.
method CWGD weights gradient diversity by the inverse square root of the Hessian.
result CWGD-Cosine reduces optimization error by up to 20% compared to standard cosine annealing.
We solve image inverse problems using a flow-based noise model.
problem Image inverse problems with complex noise patterns.
method Normalizing flow prior for maximum a posteriori estimation.
result Empirical validation on various inverse problems.
This work considers an estimation task in compressive sensing, where the goal is to estimate an unknown signal from compressive measurements that are corrupted by additive pre-measurement noise (interference, or clutter) as well as post-measurement noise, in the specific setting where some (perhaps limited) prior knowl…
When eliciting judgements from humans for an unknown quantity, one often has the choice of making direct-scoring (cardinal) or comparative (ordinal) measurements. In this paper we study the relative merits of either choice, providing empirical and theoretical guidelines for the selection of a measurement scheme. We pro…
Improved deep neural network generalization through noise resilience.
problem Understanding and predicting generalization error of deep neural networks.
method Noise resilience measures to predict generalization error.
result Secured 5th position in the PGDL competition at NeurIPS 2020.
We study the impact of input noise dimension on GAN performance.
problem Challenges in GANs like mode collapse and unstable training.
method Quantitative analysis using FID and IS on different image datasets.
result The optimal input noise dimension varies by dataset and architecture.
The log-periodic power law (LPPL) is a model of asset prices during endogenous bubbles. A major open issue is to verify the presence of LPPL in price sequences and to estimate the LPPL parameters. Estimation is complicated by the fact that daily LPPL returns are typically orders of magnitude smaller than measured price…
Robust Kalman filter for corrupted measurements.
problem Estimating linear dynamical systems from noisy measurements, especially when a fraction of measurements are adversarially corrupted.
method Developed a robust Kalman filter framework that can handle large and unknown perturbations in measurement noise.
result First strong provable guarantees for linear quadratic estimation with adversarial corruptions.
Proposes a robust similarity measure for sparse time series data.
problem Sparse time course data in biological settings.
method Gaussian processes (GP) similarity measure based on log-likelihood ratio.
result Enhanced robustness to noise compared to Euclidean distance.
ConvMMD improves inference in noisy data.
problem Inference degradation due to measurement error in noisy data.
method Convolutional Maximum Mean Discrepancy (convMMD) for inference with noisy, heteroscedastic observations.
result Established consistency and asymptotic normality of the convMMD-based estimator.
New findings on maximizing noise stability in partitions of Gaussian space.
problem Maximizing noise stability in partitions of Gaussian space.
method Analyzing the correlation between sets and their noise stability, proving conditional conjectures and hardness results.
result Hyperstable partitions maximize noise stability and have specific properties.
Study on financial systems using perturbed unimodal maps with heteroscedastic noise.
problem Analyzing systemic risk in financial systems using mathematical models.
method Investigation of one-dimensional unimodal maps perturbed by heteroscedastic noise, proving stability, convergence, and Lyapunov exponent continuity.
result Continuous dependence of average Lyapunov exponent on Markov chain parameters, and Gumbel's law for extreme values.
Unified framework for learning quantum models from limited measurements.
problem Sample complexity and measurement shots in classical learning of quantum models.
method Unified learning framework considering probabilistic quantum measurements.
result Asymmetrical effects and interplay of sample size and measurement shots on learning performance.
A new method learns noise characteristics for better state estimation in real-time systems.
problem Challenges in accurately estimating states due to uncertainty in process and measurement models.
method Proposes a learning-based approach with different loss functions to identify noise characteristics.
result Demonstrates improved performance in real-time vehicle state estimation.
Paper addresses group synchronization with incomplete measurements and proves linear convergence of GPM.
problem Orthogonal group synchronization with incomplete measurements and additive noise.
method Generalized power method (GPM) with local error bound analysis.
result Linear convergence of GPM to a global maximizer under general additive noise model.
Paper tackles noisy labels for non-decomposable performance measures.
problem Learning from noisy labels for non-decomposable performance measures.
method Designs algorithms for multiclass non-decomposable performance measures using Frank-Wolfe and Bisection methods, corrected for class-conditional noise.
result Noise-corrected algorithms are Bayes consistent, converging to optimal performance.
A new method for feature selection robust to noise and design variability.
problem Feature selection in high-dimensional regression under sampling variability and measurement error.
method Injects controlled additive noise into the design matrix, fits a base selector, and aggregates selection frequencies.
result Improved robustness compared to Stability Selection and standard base selectors.
Measurement noise limits the advantage of nonlinear models over linear models in biomedical prediction
problem Nonlinear models vs. linear models in biomedical prediction
method Measurement reliability
result Measurement noise blurs the population-optimal predictor
New method uses Wasserstein loss for data unfolding, offering better accuracy than classical techniques.
problem Removing noise or artifacts from measurements in physics experiments.
method Alternative formulation using Wasserstein loss, developing a convergent algorithm.
result Optimal transport approach offers robust, accurate performance compared to classical techniques, especially in cases with significant binning artifacts.
Proposes a learned Bayesian Cramér-Rao bound for unknown measurement models.
problem Computing the Bayesian Cramér-Rao bound requires full knowledge of priors and measurement distributions.
method Introduces a Physics-encoded score neural network to learn priors and measurements.
result Demonstrates improved sample complexity and interpretability through domain knowledge incorporation.
In this paper, we provide non-parametric statistical tools to test stationarity of microstructure noise in general hidden Ito semimartingales, and discuss how to measure liquidity risk using high frequency financial data. In particular, we investigate the impact of non-stationary microstructure noise on some volatility…
Method recovers complex-valued signals from speckle-noised measurements.
problem Recovering complex-valued signals from speckle-noised measurements.
method Bagged Deep Image Priors integrated with projected gradient descent and Newton-Schulz algorithm.
result Achieves state-of-the-art performance in MSE reduction.
Neural networks estimate SDEs with jump noise using a Tamed-Milstein scheme.
problem Estimating drift and diffusion functions in SDEs with jump noise.
method Tamed-Milstein scheme with neural networks as non-parametric approximators.
result Flexible estimation of complex nonlinear dynamics in systems with state-dependent noise.
We present a new method for the separation of superimposed, independent, auto-correlated components from noisy multi-channel measurement. The presented method simultaneously reconstructs and separates the components, taking all channels into account and thereby increases the effective signal-to-noise ratio considerably…
Study online linear regression with paid noise reduction.
problem Online linear regression with noisy features and the ability to pay for reduced noise.
method Analyzes regret against optimal predictor, uses matrix martingale concentration.
result Optimal regret rates for known and unknown noise covariance.
We consider the problem of estimating the support of a vector β∗∈Rp based on observations contaminated by noise. A significant body of work has studied behavior of ℓ1-relaxations when applied to measurement matrices drawn from standard dense ensembles (e.g., Gaussian, Bernoulli). In this paper,…
Improved SINDy autoencoder for identifying noisy dynamical systems.
problem Robust identification of noisy dynamical systems from data.
method Incorporates noise-separating neural network structures into SINDy autoencoder architecture.
result Accurately recovers latent dynamics and estimates measurement noise from noisy observations.
New predictive bandit model with noise for better decision making.
problem Optimizing decisions with limited information and noise.
method Introduced predictive bandits, derived regret bounds, and developed algorithms.
result Developed algorithms matching theoretical regret bounds.
This research explains why SGD generalizes better than ADAM in deep learning.
problem Understanding the generalization gap between SGD and ADAM in deep learning.
method Analyzing local convergence behaviors through Levy-driven stochastic differential equations (SDEs).
result SGD is more locally unstable and better escapes from sharp minima to flatter ones, leading to better generalization.
Method improves SINDy for noisy nonlinear systems.
problem Recover nonlinear dynamical systems from noisy data.
method Reweighted ℓ1-regularized least squares. result Improved accuracy and robustness in noisy conditions.
Recovering a high-quality image from noisy indirect measurements is an important problem with many applications. For such inverse problems, supervised deep convolutional neural network (CNN)-based denoising methods have shown strong results, but the success of these supervised methods critically depends on the availabi…
This work establishes distribution-free upper and lower bounds on the minimax label complexity of active learning with general hypothesis classes, under various noise models. The results reveal a number of surprising facts. In particular, under the noise model of Tsybakov (2004), the minimax label complexity of active …