Paper proposes a method to train deep text classification models robust to label noise.
problem Training deep text classification models with noisy labels.
method Introduces a non-linear processing layer (noise model) into CNN architecture, learned jointly with CNN weights.
result The approach enables better sentence representations and robustness to extreme label noise.
New methods for handling time-varying label noise in time series classification.
problem Temporal label noise in time series classification tasks.
method Proposed methods to estimate temporal label noise function directly from data.
result Our methods lead to state-of-the-art performance under diverse types of temporal label noise.
Enhanced consistency bounds derived for classification under a new noise condition.
problem Enhanced consistency bounds for classification under a new noise condition.
method Model Margin Noise (MM noise) assumption, derived enhanced H-consistency bounds.
result Enhanced H-consistency bounds under MM noise condition, interpolates between linear and square-root regimes.
Machine learning classifies IoT noise in smart cities.
problem Noise classification in smart cities.
method Mel-frequency cepstral coefficients for audio features, supervised classification (SVM, k-NN), parameter optimization.
result Noise classification accuracy of 85% - 100%.
Quantum classification robustness improved via quantum hypothesis testing.
problem Vulnerability of quantum classification algorithms to input perturbations.
method Formalized link between quantum hypothesis testing and robustness, developed practical protocols.
result Tight robustness condition independent of noise source (natural or adversarial).
New particle-based method improves semi-supervised learning robustness to label noise.
problem Label noise degrades semi-supervised learning accuracy.
method Particle competition and cooperation algorithm for robust semi-supervised learning.
result Improved robustness to label noise compared to existing methods.
Study investigates classification with unknown label noise in non-compact feature spaces.
problem Classification in the presence of unknown class-conditional label noise in non-compact feature spaces.
method Determines minimax optimal learning rates and presents an adaptive algorithm for classification.
result Optimal learning rates differ from those without label noise, displaying interesting threshold behavior.
The paper cleans label noise in supervised classification using Bernoulli sampling.
problem Label noise degrades supervised classifier performance.
method Proposes a label noise cleaning method based on Bernoulli random sampling.
result The method separates clean and noisy observations without prior label information.
NoiseRank reduces label noise without supervision, improving classification accuracy.
problem Label noise in datasets from noisy channels.
method NoiseRank uses Markov Random Fields to estimate and rank instances based on their noise probability.
result NoiseRank improves classification accuracy on noisy datasets.
Proposes a method to improve classification robustness against label noise.
problem Improving classification robustness against label noise.
method Extends a simple regression approach to classification, modeling labels as samples from a logistic-normal distribution.
result The method improves robustness against label noise in classification.
Noise makes learning linear thresholds hard, but algorithms can still learn near-optimal thresholds.
problem Learning linear thresholds in noisy data.
method Exploiting natural assumptions on data-generating process.
result Efficient learning of near-optimal linear thresholds is still possible with small data even in the presence of noise.
Paper improves image classification accuracy with a new Noise Modeling Network.
problem Improving performance of multi-label image classifiers with noisy or missing labels.
method Integrates a Noise Modeling Network (NMN) with a CNN to jointly learn noise distribution and CNN parameters.
result Consistently improves classification performance on MSR-COCO and MSR-VTT datasets.
Graph filtering reduces intra-class noise for improved classification accuracy.
problem Noise in training data affects classifier performance.
method Graph filtering to connect similar samples within a class.
result Asymptotic reduction of intra-class variance while maintaining mean.
New algorithms reduce communication costs in collaborative learning.
problem Reducing communication costs in collaborative learning.
method Distributed boosting and adaptation to classification noise.
result Communication-efficient algorithms for collaborative PAC learning robust to noise.
A deep abstaining classifier tackles label noise in deep learning.
problem Label noise in deep learning training data.
method Proposes a loss function allowing deep neural networks to abstain from making predictions on confusing samples.
result Deep abstaining classifier (DAC) improves robust learning in various types of label noise.
Graph attention is not always beneficial; conditions for perfect node classification are identified.
problem Understanding when graph attention mechanisms improve node classification performance.
method Theoretical analysis using Contextual Stochastic Block Models (CSBMs).
result Graph attention mechanisms are more effective when structure noise exceeds feature noise, and simpler graph convolution operations are better when feature noise predominates.
In this paper, we study a classification problem in which sample labels are randomly corrupted. In this scenario, there is an unobservable sample with noise-free labels. However, before being observed, the true labels are independently flipped with a probability ρ∈[0,0.5), and the random label noise can be class-co…
Improved graph classification with noisy labels using GNNs and loss correction.
problem Robustness of GNNs to symmetric label noise.
method Combining GNNs with loss correction methods.
result Test accuracy improvement under noisy conditions.
Simple method improves deep classifier accuracy under noisy labels.
problem Training deep classifiers with noisy labels.
method Probabilistic approach using temperature parameterized softmax.
result Improves accuracy, log-likelihood and calibration on noisy datasets.
New algorithm controls type I error in NP classification under label noise.
problem Label noise affects NP classification methods, reducing power.
method Proposes a label-noise-adjusted Neyman-Pearson algorithm.
result Improves power while controlling type I error under desired level.
Study shows squared loss is robust for binary classification with noisy features.
problem Learning binary classifiers with noisy features.
method Sy-De and Asy-In attribute noise models, analyzing l0−1 and lsq losses. result Squared loss is robust in Sy-De model but not in Asy-In model.
Develops NPMC method for noisy labels, improving multiclass classification accuracy.
problem Asymmetric misclassification costs and label noise in multiclass classification.
method Empirical likelihood approach using exponential tilting density ratio model.
result Root n consistent and asymptotically normal estimators for clean labels and noise mechanism.
Study examines how noise in training data affects classification of outliers.
problem Impact of label noise on classification of outlier observations.
method Investigates BCOPS algorithm with synthetic and real datasets.
result Noise in training data significantly impacts model performance for outlier classification.
Improved image classification accuracy with a probabilistic model of label noise.
problem Noisy labels in large-scale image classification datasets.
method A probabilistic model using a multivariate Normal distribution on the final hidden layer of a neural network, capturing input-dependent label noise.
result Significantly improved accuracy on various datasets compared to standard methods.
SwishNet improves speech, music, and noise classification and segmentation.
problem Speech, Music, and Noise classification/segmentation for audio processing.
method Proposes a fast and lightweight 1D CNN (SwishNet) for MFCC features, trained with knowledge distillation from ImageNet.
result Achieved high accuracy (>97% clip classification, >93% frame-wise segmentation) on MUSAN corpus.
In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning deep networks under label noise focus on modifying the network architecture and…
Study robustness of conformal prediction to label noise in regression and classification.
problem Robustness of conformal prediction to label noise in regression and classification.
method Characterized robustness of conformal prediction for both regression and classification problems, extending theory to control general loss functions.
result Conformal prediction and risk-controlling techniques can achieve conservative risk over clean ground truth labels with noisy labels.
Survey of deep learning methods for noisy labels in image classification.
problem Label noise in deep learning image classification.
method Noise model based and noise model free methods.
result Deep learning is robust to label noise but requires counter algorithms.
A method to approximate instance-dependent label noise using instance-confidence embedding.
problem Real-world label noise that depends on individual instances.
method Variational approximation with instance embedding to capture instance-specific label corruption.
result ICE method effectively approximates instance-dependent noise and detects ambiguous instances.
Logistic regression can handle noisy labels effectively when labels are imperfectly assigned by multiple experts.
problem Label noise in supervised classification due to manual labelling by multiple experts.
method Using approximate posterior probabilities of class membership from multiple experts to train logistic regression models.
result Logistic regression can be robust to label noise when classification difficulty is the only source of errors.
Improved speaker verification system detects replay attacks.
problem Detecting replay attacks in speaker verification systems.
method Multi-task learning of noise classes (replay noise, recording environment, recording device noises) and spoofing detection.
result Performance improved by 30% on ASVspoof2017 datasets.
The paper develops GP classifiers for noisy inputs in multi-class classification.
problem Input noise in real-world data affects supervised learning performance.
method Developed multi-class Gaussian Process classifiers using variational inference.
result The proposed methods outperform noise-ignoring GP classifiers in predictive distribution.
Study presents a dataset and methods to handle noisy labels in sound event classification.
problem Label noise in sound event classification datasets.
method Developed a dataset with noisy labels and evaluated CNN baseline systems.
result Training with large amounts of noisy data can outperform training with carefully-labeled data.
Paper presents robust boosting methods for label noise.
problem Boosting methods degrade in noisy environments.
method Robust Minimax Boosting (RMBoost) with theoretical guarantees.
result RMBoost provides strong classification accuracy and robustness.
A new method improves graph-based semi-supervised classification by removing noise and mixed signs.
problem Inaccurate soft labels and noise in graph-based semi-supervised classification.
method Triple-matrix-recovery-based robust auto-weighted label propagation framework (ALP-TMR).
result Improved robustness to noise and outliers in label estimation.
New model shows neural networks can use noise to improve long-tailed data classification.
problem Understanding overfitting in neural networks with long-tailed data.
method Refined feature-noise data model incorporating class-dependent heterogeneous noise.
result Neural networks can leverage data noise to learn implicit features improving long-tailed data classification.
Study shows topological features improve time series classification.
problem Classifying stochastic processes with varying noise and sampling.
method Topological data analysis features compared to statistical and raw features.
result Topological features lead to better classification performance.
Automatically detecting sound units of humpback whales in complex time-varying background noises is a current challenge for scientists. In this paper, we explore the applicability of Convolution Neural Network (CNN) method for this task. In the evaluation stage, we present 6 bi-class classification experimentations of …
Unified scalable GPCs for various likelihoods using additive noise.
problem Scalability issues and intractable inference in GPC for big data and non-Gaussian likelihoods.
method Additive noise to unify scalable GPCs for multiple likelihoods, using variational inference.
result Empirically superior results for binary/multi-class classification tasks with up to two million data points.
CNNs learn about input data uncertainties, improving classification performance.
problem Errors in measurements are often neglected in ML, affecting classification performance.
method Constructed a model with known noise levels and used CNNs to learn about uncertainties.
result CNNs can incorporate information about input data uncertainties, improving classification performance.
New research shows that binary classification can be done with noisy data, but only if there are clean samples available.
problem Learning binary classification with instance and label dependent label noise.
method Theoretical analysis and empirical risk minimization.
result Empirical risk minimization achieves the optimal excess risk bound without additional assumptions.
Proposes NCMN to remove feature correlation in multiplicative noise.
problem High feature correlation in multiplicative noise reduces network performance.
method Exploits batch normalization to remove correlation effect.
result Significantly improves performance on image classification tasks.
Study shows SQ hardness for multiclass linear classification with random noise.
problem Complexity of multiclass linear classification with random noise.
method Proves super-polynomial SQ lower bounds for MLC with RCN.
result Super-polynomial SQ lower bounds for MLC with RCN.
This research tackles image classification with noise, proposing committees of CNNs.
problem Image classification with concurrent feature and label noise.
method Committees of Convolutional Neural Networks (CNNs) for MNIST, CIFAR-10, and CIFAR-100 datasets.
result Committees outperform single models in noisy conditions, especially on difficult datasets.
Study examines noise sensitivity of DNNs for binary classification.
problem Understanding non-robustness of DNN classifiers under noise.
method Defined and extended noise sensitivity and stability concepts for Boolean functions, applied to DNN models.
result Sorted out the relation between definitions and properties of DNN architectures under noise.
S-SGD adds symmetrical noise to weights to avoid sharp minima in deep learning.
problem SGD does not always converge to a flat minimum, leading to poor generalization.
method Symmetrical weight noise injection in SGD.
result S-SGD outperforms conventional SGD and weight-noise injection methods in large batch training.
Unsupervised learning classifies transient noise in gravitational wave detectors.
problem Transient noise interferes with gravitational wave signals, causing instability.
method Combines variational autoencoder and invariant information clustering.
result Consistent classification with Gravity Spy project labels.
Crowdsourced PAC learning algorithm reduces labeling tasks for noisy data.
problem Learning from noisy labels in crowdsourced data.
method Three-step algorithm combining voting, bandits, and noisy-PAC learning.
result Reduces the number of tasks workers need to label for PAC learning.