New method tackles label noise on imbalanced datasets by considering class-specific uncertainty.
problem Label noise and class imbalance in imbalanced datasets.
method Epistemic and aleatoric uncertainty-aware class-specific noise modeling.
result Proposed ULC framework improves performance on imbalanced datasets.
Additive noise protects privacy in releasing datasets for SVM classification.
problem Maintaining privacy in releasing datasets for SVM classification.
method Additive noise applied to obfuscate the dataset, optimizing privacy and utility measures.
result Optimal noise distribution ensures close classifier performance between original and obfuscated datasets, achieving local differential privacy.
Study real-world noisy labels from human annotations for better understanding.
problem Understanding and modeling real-world label noise in machine learning.
method Developed two new benchmark datasets (CIFAR-10N, CIFAR-100N) with human-annotated real-world noisy labels.
result Real-world noisy labels exhibit instance-dependent patterns, not class-dependent as previously assumed.
Accurately annotating large scale dataset is notoriously expensive both in time and in money. Although acquiring low-quality-annotated dataset can be much cheaper, it often badly damages the performance of trained models when using such dataset without particular treatment. Various methods have been proposed for learni…
Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective technique for accounting for label noise when training deep neural networks. We augment…
Study improves model robustness in noisy datasets.
problem Instance-specific label noise in robust classification tasks.
method Coordinated Sparse Recovery (CSR) method introduces a collaboration matrix and confidence weights to reduce generalization error.
result CSR and CSR+ significantly reduce generalization error compared to existing methods.
Fluorescence microscopy has enabled a dramatic development in modern biology. Due to its inherently weak signal, fluorescence microscopy is not only much noisier than photography, but also presented with Poisson-Gaussian noise where Poisson noise, or shot noise, is the dominating noise source. To get clean fluorescence…
Proposes DeGLIF to denoise graph data for label noise robustness.
problem Label noise in graph data makes node classification challenging.
method Uses leave-one-out influence function to denoise graph data.
result DeGLIF improves accuracy in node classification on noisy datasets.
HeMPPCAT improves PCA for data with varying noise.
problem PCA's suboptimal performance on data with heterogeneous noise.
method HeMPPCAT uses a GEM algorithm to estimate factors, means, and noise variances.
result Improved factor estimates and clustering accuracy compared to MPPCA.
The paper investigates how dataset quality and heterogeneity affect model confidence in machine learning.
problem Understanding how dataset quality and heterogeneity impact model confidence in machine learning.
method The study uses theoretical explanations and experimental demonstrations to investigate the effects of dataset size, label noise, and class heterogeneity on model confidence.
result Label noise reduces model confidence, while reduced dataset size increases it, and class heterogeneity leads to inconsistent confidence across classes.
Proposes a progressive label correction method for feature-dependent label noise.
problem Real-world large-scale datasets often suffer from heterogeneous, feature-dependent label noise.
method A progressive label correction algorithm that iteratively refines the model.
result A classifier trained with this strategy converges to be consistent with the Bayes classifier for various noise patterns.
NoiseRank reduces label noise without supervision, improving classification accuracy.
problem Label noise in datasets from noisy channels.
method NoiseRank uses Markov Random Fields to estimate and rank instances based on their noise probability.
result NoiseRank improves classification accuracy on noisy datasets.
SAP corrects model for label noise by identifying and removing noisy samples.
problem Label corruption degrades model performance; acquiring perfect labels is costly.
method SAP uses SVD to identify and project model weights onto a clean activation space.
result SAP improves model generalization by up to 6% on CIFAR dataset with 25% synthetic corruption.
Optimal Gaussian noise mechanisms achieve nearly optimal error in unbiased mean estimation.
problem Efficiently estimating the mean of high-dimensional data while preserving privacy.
method Differential privacy mechanisms with Gaussian noise, focusing on optimal covariance.
result Gaussian noise mechanisms achieve nearly optimal error among all private unbiased mean estimation mechanisms.
TrustNet robustly learns noise patterns from trusted data to improve weakly-supervised classification.
problem Robustness to label noise in weakly-supervised learning.
method TrustNet learns noise patterns from trusted data, then trains a robust classifier using these patterns.
result TrustNet outperforms state-of-the-art methods in robustness to various noise patterns.
This paper tackles label noise in deep learning for medical image analysis.
problem Label noise impacts deep learning models in medical image analysis.
method Review of state-of-the-art techniques and experiments with label noise in medical datasets.
result Developed new methods to combat label noise in deep models for medical image analysis.
Paper tackles label noise in large datasets, purifying noisy data with a nonparametric framework.
problem Label noise in large-scale datasets with coarse labels.
method Develops a model-agnostic nonparametric framework for classification.
result Framework purifies noisy data using a small clean dataset and manages ambiguous samples.
This paper studies how label noise affects Federated Learning.
problem The impact of label noise on Federated Learning.
method The paper derives an upper bound for the generalization error and conducts experiments on MNIST and CIFAR-10 datasets.
result The global model accuracy decreases linearly with increasing label noise, consistent with theoretical analysis.
We develop coreset techniques for noisy clustering with provable guarantees.
problem Clustering with stochastic noise in datasets.
method Surrogate error metrics and coreset construction algorithm.
result Improved coreset size and better guarantees on true clustering cost.
Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much attention, training text classification models have not. In this paper, we propose an…
Study examines the training process of an unsupervised learning model for detecting gravitational-wave transient noise.
problem Transient noise in gravitational-wave detector data causes instability and signal overlap.
method Unsupervised deep learning with variational autoencoder and invariant information clustering applied to the Gravity Spy dataset.
result Training process of the unsupervised learning architecture is examined and reported.
Proposes a method to compare noisy high-dimensional datasets with low-dimensional manifolds.
problem Comparing distributions on manifolds in noisy high-dimensional datasets.
method Linking low-rank structure to manifold geometry, developing a scale-invariant distance measure.
result Superior robustness and statistical power compared to existing methods.
DA-GNN improves robustness of GNNs by modeling noise dependencies.
problem Real-world graph node features often contain noise, leading to performance degradation in GNNs.
method DA-GNN captures noise dependencies using variational inference and new benchmark datasets.
result DA-GNN consistently outperforms existing baselines across various noise scenarios.
Study reveals how data density affects similarity learning in noisy conditions.
problem Impact of noise on similarity learning in Siamese Neural Networks.
method Investigated Pair Label Noise and Single Label Noise on Siamese Neural Networks (SNNs).
result Data density is crucial for generalization in SNNs, leading to a phenomenon called DIBS.
A two-stage optimization framework reduces label noise in federated learning.
problem Label noise from noisy clients degrades federated learning model performance.
method MaskedOptim framework: detects noisy clients, corrects labels, and aggregates models robustly.
result Our framework improves model robustness and data quality in federated learning.
Differentially private learning avoids iterative optimization in parameter space.
problem Differentially private training of neural networks
method Hypernetworks trained on public datasets
result Significantly reduces noise in parameter space
Improved image classification accuracy with a probabilistic model of label noise.
problem Noisy labels in large-scale image classification datasets.
method A probabilistic model using a multivariate Normal distribution on the final hidden layer of a neural network, capturing input-dependent label noise.
result Significantly improved accuracy on various datasets compared to standard methods.
Paper introduces ρ-Perfect to estimate model-human correlation in subjective datasets.
problem Inherent noise in subjective ratings limits model-human correlation quantification.
method Defines ρ-Perfect as highest achievable correlation between perfect predictor and human ratings. Estimates based on heteroscedastic noise scenarios. result Demonstrates ρ-Perfect can distinguish model limitations from data quality issues. A deep learning model improves seismic noise reduction.
problem Seismic noise attenuation in pre-stack data processing.
method N2N-Seismic model based on residual neural networks.
result The model significantly outperforms conventional approaches in noise reduction metrics.
A new method handles label noise by leveraging causal information.
problem Label noise degrades deep learning performance.
method Proposes a novel generative approach using a structural causal model.
result Improves classifier performance on label-noise datasets.
GROVER improves word representations by gradually adding random noises during training.
problem Improving word representations for better model performance.
method Gradually adding random noises to word embeddings during training.
result GROVER improves model performances on most text classification datasets.
Paper benchmarks real-world noisy labels and proposes a method to improve deep learning performance.
problem Understanding deep learning with real-world noisy labels.
method Develops a simple method to handle both synthetic and real noisy labels.
result Method achieves best results on benchmark datasets and web noise.
ANT improves TS diffusion models by automatically determining noise schedules.
problem Suboptimal performance of TS diffusion models due to lack of domain-specific noise schedules.
method ANT proposes an adaptive noise schedule that automatically determines proper noise schedules for TS datasets based on their statistics.
result ANT achieves state-of-the-art performance on various TS tasks, including forecasting, refinement, and generation.
The paper studies how noisy labels impact decision-making in machine learning.
problem The impact of noisy labels on decision-making in machine learning.
method Introducing a notion of regret, studying standard approaches, and estimating individual-level mistakes.
result Standard approaches can lead to unforeseen mistakes for individuals, revealing the need for anticipation.
We present a machine learning based method for noise classification using a low-power and inexpensive IoT unit. We use Mel-frequency cepstral coefficients for audio feature extraction and supervised classification algorithms (that is, support vector machine and k-nearest neighbors) for noise classification. We evaluate…
Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy can be quantitatively characterized in terms of the noise ratio in datasets. In…
Noise2Inverse removes artifacts in noisy CT images without needing clean data.
problem Removing artifacts in noisy CT images.
method Noise2Inverse uses a deep CNN trained on multiple statistically independent reconstructions of the same noisy data.
result Noise2Inverse improves peak signal-to-noise ratio and structural similarity index compared to existing methods.
Paper improves image classification accuracy with a new Noise Modeling Network.
problem Improving performance of multi-label image classifiers with noisy or missing labels.
method Integrates a Noise Modeling Network (NMN) with a CNN to jointly learn noise distribution and CNN parameters.
result Consistently improves classification performance on MSR-COCO and MSR-VTT datasets.
Proposes a new model for noisy labels considering multiple labelers and adversarial attacks.
problem Real-world noisy label models with multiple labelers and adversarial attacks.
method Labeler-dependent noise model with adversarial attack vectors.
result State-of-the-art approaches for learning from noisy labels are defeated by adversarial label attacks.
We address noisy Euclidean distances in high dimensions, estimating noise levels and correcting distances.
problem Distorted pairwise Euclidean distances due to heteroskedastic noise.
method Developed a hyperparameter-free approach to jointly estimate noise magnitudes and correct distances.
result Our method provides accurate noise magnitude estimates and corrected distances in high-dimensional settings.
Feature noise causes loss discrepancies across groups even with equal data.
problem Loss discrepancies observed in learning procedures across different groups.
method Characterized the effect of feature noise on loss discrepancy in linear regression.
result Feature noise leads to loss discrepancy even when groups have equal data.
Algorithm selects public datasets for private machine learning.
problem Choosing the most suitable public dataset for private machine learning.
method Measures gradient subspace distance between public and private datasets.
result Excess risk scales with the subspace distance between gradients.
Improved autoregressive models generate higher quality images and are more robust to noise.
problem Generating high-quality images from autoregressive models.
method Noise conditional maximum likelihood estimation (MLE) with score-based sampling.
result Models trained with noise conditional MLE achieve better test likelihoods and generate higher quality images.
Simple methods boost sound event classifier accuracy by 2.5%.
problem Label noise in sound event classification datasets.
method Label smoothing regularization, mixup, and noise-robust loss functions.
result Simple methods can boost accuracy by up to 2.5%.
Method reweights instances and classes to improve robustness in noisy data.
problem Improving deep learning performance in the presence of label noise.
method Formulates constrained optimization problems to assign importance weights to instances and class labels.
result Significant performance gains observed in benchmark datasets with label noise.
Deep neural networks (DNN)-based machine learning (ML) algorithms have recently emerged as the leading ML paradigm particularly for the task of classification due to their superior capability of learning efficiently from large datasets. The discovery of a number of well-known attacks such as dataset poisoning, adversar…
Improves generative models by using heavy-tailed noise in score matching.
problem High-dimensional limitations of Gaussian noise in generative models.
method Extended DSM to generalised normal distribution, relaxed key assumptions, developed iterative noise scaling algorithm.
result Heavy-tailed DSM leads to improved generative performance.
Simple method improves deep classifier accuracy under noisy labels.
problem Training deep classifiers with noisy labels.
method Probabilistic approach using temperature parameterized softmax.
result Improves accuracy, log-likelihood and calibration on noisy datasets.