Paper proposes GAN frameworks for learning clean signals from superposed structured components.
problem Learning clean signals from superposed structured components when clean samples are not available.
method Proposes denoising-GAN and demixing-GAN frameworks to learn the structure of components.
result Demonstrates competitive performance in tasks like denoising, demixing, and compressive sensing.
Study reveals why polls were inaccurate in 2016 US election.
problem Why opinion polls were inaccurate in 2016 US election.
method Proposes clean sensing framework for optimal parameter estimation from heterogeneous data sources.
result Optimal polling strategy allocates resources based on data quality and quantity.
TS-Fault benchmarks TSF models against structural faults.
problem Evaluating the robustness of time series forecasting models against structured events.
method TS-Fault uses parameterized fault scenarios with controllable difficulty.
result Three findings contradict common leaderboard intuition.
CNNs improve InSAR image denoising and coherence estimation.
problem Noise in InSAR imagery corrupts ground movement estimates.
method Autoencoder CNN architectures for denoising and preprocessing.
result Proposed method outperforms four established methods.
We propose a method to clean covariance matrices of nonstationary systems by using time-independent eigenvalues.
problem Noise in covariance matrices of nonstationary systems with time-independent eigenvalues.
method Data-driven approach to use independent eigenvalues encoding long-term influence of future on present.
result Our method outperforms optimal stationary methods for filtering covariance matrix and its inverse.
Neural networks learn clean data patterns first, then noisy data, leading to improved performance initially but deteriorating later.
problem Improvement in prediction error on clean data during early training of neural networks with noisy labels.
method Theoretical analysis and experiments to explore the dynamics of gradient descent and the impact of clean and noisy data.
result Neural networks prioritize learning clean data patterns first, leading to improved performance initially but deteriorating later due to diminishing gradient dominance of clean samples over noisy ones.
Consider a linear regression model where the design matrix X has n rows and p columns. We assume (a) p is much large than n, (b) the coefficient vector beta is sparse in the sense that only a small fraction of its coordinates is nonzero, and (c) the Gram matrix G = X'X is sparse in the sense that each row has relativel…
The paper cleans label noise in supervised classification using Bernoulli sampling.
problem Label noise degrades supervised classifier performance.
method Proposes a label noise cleaning method based on Bernoulli random sampling.
result The method separates clean and noisy observations without prior label information.
Physics-informed denoising improves sensor data accuracy without needing clean data.
problem Noise in real-life sensor data affects system performance and reliability.
method Physics-informed denoising model that uses algebraic relationships between sensor measurements governed by physical laws.
result Achieved state-of-the-art performance in various real-world applications.
PClean automates Bayesian data cleaning for specific datasets.
problem Bayesian inference for diverse and complex data cleaning.
method Domain-specific probabilistic programming language with custom models and inference.
result PClean programs outperform general-purpose PPLs in accuracy and runtime.
Paper recovers multi-subspace matrices from permuted data.
problem Recovering a multi-subspace matrix from permuted data with corrupted columns.
method Four-stage algorithm pipeline: outlier identification, subspace reconstruction, outlier classification, unsupervised sensing.
result The pipeline provides theoretical guarantees for reliable multi-subspace matrix recovery.
It is known that evaluating a certain approximation to the Jones polynomial for the plat closure of a braid is a BQP-complete problem. That is, this problem exactly captures the power of the quantum circuit model. The one clean qubit model is a model of quantum computation in which all but one qubit starts in the maxim…
This paper presents a statistical method of single-channel speech enhancement that uses a variational autoencoder (VAE) as a prior distribution on clean speech. A standard approach to speech enhancement is to train a deep neural network (DNN) to take noisy speech as input and output clean speech. Although this supervis…
INN method refines clean labeled data from noisy labels.
problem Handling noisy labels in deep neural networks.
method INN method based on memorization effect at neighbor regions.
result INN method resolves memorization effect shortcomings.
Study improves resilience against adversarial clean-label attacks in real and noisy settings.
problem Ensuring accurate predictions in the presence of adversarial clean-label samples.
method Sequential learning from a stream of i.i.d. data, allowing abstention for uncertain predictions.
result Theoretical analysis and adaptations for the agnostic setting with a clean-label adversary and noise.
ENSURE framework trains deep image recon algorithms without clean data.
problem Lack of clean, fully sampled ground-truth data for deep learning image reconstruction.
method Introduces ENSURE framework, a generalization of SURE and GSURE to random sampling patterns.
result ENSURE loss function is an unbiased estimate for true mean-square error.
Trimming helps in conformal prediction when it separates anomaly scores.
problem Effectiveness of trimming in conformal prediction under contamination.
method Analyse fixed-threshold trimming as a replacement of the contaminated calibration law with a retained law.
result Trimming helps when it separates anomaly scores, reducing clean-target coverage to a one-dimensional score-CDF transfer problem.
New method improves false-/true-positive-rate estimation in fraud detection with noisy labels.
problem Estimating FPR/TPR in fraud detection with class-conditional label noise.
method Directly cleaning model's validation data to de-correlate cleaning error with model scores.
result Improves accuracy of FPR/TPR estimates, especially in asymmetric label noise scenarios.
A new method improves graph-based semi-supervised classification by removing noise and mixed signs.
problem Inaccurate soft labels and noise in graph-based semi-supervised classification.
method Triple-matrix-recovery-based robust auto-weighted label propagation framework (ALP-TMR).
result Improved robustness to noise and outliers in label estimation.
PA-GNN enhances GNN robustness against poisoning attacks using clean graph knowledge.
problem Improving robustness of GNNs against poisoning attacks.
method PA-GNN uses a penalized aggregation mechanism and meta-optimization to transfer robustness from clean graphs.
result PA-GNN significantly improves GNN robustness against poisoning attacks on real-world graphs.
Bullseye Polytope improves clean-label poisoning attacks in transfer learning.
problem Poisoning neural networks with correctly labeled data.
method Creates poison images with centers close to target images in feature space.
result Improves attack success rate by 26.75% in end-to-end transfer learning.
In supervised learning one wishes to identify a pattern present in a joint distribution P, of instances, label pairs, by providing a function f from instances to labels that has low risk EPℓ(y,f(x)). To do so, the learner is given access to n iid samples drawn from P. In many real world problem…
SSMs can be poisoned with clean labels, leading to generalization failure.
problem The implicit bias of SSMs can be manipulated by including special training examples with clean labels.
method Formal proof and empirical demonstration of the phenomenon.
result SSMs can fail to generalize even with clean labels, due to the inclusion of special training examples.
Cincer cleans both new and past data by identifying and relabeling suspicious and counter-examples.
problem Sequential learning under label noise, especially in applications with human supervision.
method Cincer uses example-based explanations to identify and relabel suspicious and counter-examples, leveraging Fisher information matrix approximation.
result Cincer achieves better data and models by clarifying the model's suspicions, especially with FIM approximation.
Improved portfolio optimization method yields better risk-adjusted returns.
problem Optimizing global minimum variance portfolios with reduced risk.
method k-fold boosted k−BAHC covariance cleaning procedure for correlation matrices. result Our method outperforms other filtering methods in Sharpe ratios, despite higher turnover.
We apply basic statistical reasoning to signal reconstruction by machine learning -- learning to map corrupted observations to clean signals -- with a simple and powerful conclusion: it is possible to learn to restore images by only looking at corrupted examples, at performance at and sometimes exceeding training using…
Adversarial training leads to clean data generalization with significant robust overfitting gap.
problem Significant robust generalization gap in adversarial training.
method Two theoretical views: representation complexity and training dynamics.
result ReLU nets with O(ND) extra parameters can achieve CGRO. In this paper, we present a reverberation removal approach for speaker verification, utilizing dual-label deep neural networks (DNNs). The networks perform feature mapping between the spectral features of reverberant and clean speech. Long short term memory recurrent neural networks (LSTMs) are trained to map corrupted…
Improved robust regression with clean covariates achieves better rates than Huber's model.
problem Robust regression under adaptive contamination of responses with clean covariates.
method Exploiting clean covariates to construct an estimator achieving better rates than Huber's model.
result Improved estimation rate even with constant contamination, achieving consistency.
Self-supervised method predicts clean signal and noise distribution from noisy images.
problem Blind denoising and noise estimation in biomedical images with limited clean data.
method Two neural networks jointly predict clean signal and noise distribution from noisy observations.
result Significantly outperforms state-of-the-art algorithms on six biomedical image datasets.
For a real valued periodic smooth function u on R, n≥0, one defines the osculating polynomial φs (of order 2n+1) at a point s∈R to be the unique trigonometric polynomial of degree n, whose value and first 2n derivatives at s coincide with those of u at s. We will say that a point s is a clean maximal flex …
A method to learn from noisy labels without a clean validation set.
problem Learning from samples with noisy labels.
method Limited Gradient Descent: modifying labels to estimate optimal stopping timing.
result Comparable and sometimes superior generalization performance compared to methods relying on clean validation sets.
R package tsrobprep cleans and prepares time series data robustly.
problem Inefficient methods for handling missing values and outliers in time series data.
method Model-based methods for imputation and outlier detection considering time series properties.
result Robust and tunable methods for data preprocessing in time series analysis.
Enhances deep learning robustness to noise without sacrificing clean data accuracy.
problem Robustness of deep neural networks to input noise.
method Discriminative loss at penultimate layer and class-wise feature alignment with Gaussian noise.
result Improves robustness to various perturbations without degrading clean data accuracy.
New method generates clean data from corrupted observations.
problem Generating clean data from corrupted observations.
method Iterative update of a transport map using black-box corruption channel access.
result Converges to a self-consistent transport map that effectively inverts the corruption channel.
Study proposes a clustering and logistic regression algorithm for PU classification under Non-SCAR.
problem PU classification under Non-SCAR condition when SCAR condition is unsatisfied.
method 2-means clustering followed by logistic regression.
result Efficacy of the proposed algorithm demonstrated on 11 real data sets and a synthetic set.
This work uses GANs to improve CT image reconstruction from limited angles.
problem Under-determined linear inverse problem in limited angle CT reconstruction.
method Robust GAN prior for image manifold projection.
result Significant improvement in reconstruction quality.
Paper proposes training deep nets on noisy labels without manual annotation.
problem Training deep neural networks on noisy labels without manual annotation.
method Directly train deep neural network on noisy candidate labels, early stopping to avoid overfitting.
result Training on noisy candidate labels yields higher test performance than on clean data.
Improved speech translation model using cleaned data and ensemble decoding.
problem End-to-end speech translation from English to German.
method Fine-tuning on cleaned data, weight normalization, label smoothing, checkpoint averaging, ensemble decoding.
result Ensemble model achieved a BLEU score of 10.24 on test data.
Enhances neural network robustness with Mixup and TLAT.
problem Neural networks are sensitive to various perturbations and adversarial examples.
method Combines Mixup augmentation with Targeted Labeling Adversarial Training (TLAT).
result M-TLAT increases robustness against 19 corruptions and 5 adversarial attacks without reducing clean sample accuracy.
Game theory helps machine learn better from adversarial queries.
problem Adversarial evasion in machine learning prediction.
method Repeated Bayesian Sequential Game to balance classifier selection and query type.
result Learner selects appropriate classifier for clean vs. adversarial queries.
The US Census Bureau corrupts data to protect privacy, but we show how to clean and analyze it effectively.
problem Analyzing Census data with intentional corruption to maintain privacy.
method Formulated a semiparametric model, proposed data cleaning, estimation, and inference procedures.
result Demonstrated that data cleaning can maintain precision and provided theoretical and empirical support.
A graph helps understand Artin groups better.
problem Understanding the structure of Artin groups.
method Constructing a marking graph with transverse parabolic subgroups and defining natural moves.
result The marking graph is quasi-isometric to the group modulo its center.
Develops a method to compute Morse homology for clean but not necessarily transverse intersections.
problem Computing Morse homology for clean but not necessarily transversely intersecting manifolds.
method Constructs minimal semi-global Kuranishi structures for moduli spaces of Morse trajectories, generalizing obstruction bundle gluing.
result Obtains iterated gluing equals simultaneous gluing, maintaining computability.
This work uses encoder-decoder networks to denoise one-dimensional signals by aligning clean and noisy signal latent representations.
problem Noise removal in one-dimensional signals, especially in medical and motion signals.
method Encoder-decoder architecture with adversarial learning to align clean and noisy signal latent representations.
result Better performance on electrocardiogram and motion signal denoising compared to learning-based and non-learning approaches.
Study connects covariance cleaning theory to information theory for heavy-tailed distributions.
problem Optimizing covariance matrices for heavy-tailed distributions using information theory.
method Minimizing Frobenius norm and information loss between true and estimated covariance matrices.
result Asymptotic regime of large matrices minimizes information loss for Student's t distributions.
Paper cleans option price datasets by removing outliers.
problem Unusual option prices in datasets.
method Statistical techniques to identify and remove outliers.
result Removes option prices violating no arbitrage assumption.
Bayesian method improves segmentation accuracy with noisy labels.
problem Annotation errors in semantic segmentation due to mislabeling and spatial correlations.
method Approximate Bayesian estimation with spatially correlated discrete distributions and variational inference.
result The method achieves performance comparable to clean labels under moderate noise levels.