Generative model creates synthetic unlabeled data for SSL.
problem Training SSL models without real unlabeled datasets.
method Meta-optimized synthetic samples generated from generative models.
result Synthetic samples improve SSL performance more efficiently than real unlabeled data.
MTL method uses unlabeled data with pseudo labels to improve classification with disjoint datasets.
problem Improving classification performance with disjoint labeled datasets using unlabeled data.
method Proposes MTL-SA method to select and augment unlabeled data with confident pseudo labels and close distribution to labeled data.
result Extensive experiments show the effectiveness of MTL-SA method in improving classification performance.
MixMOOD improves SSDL by selecting unlabelled data based on deep feature similarity.
problem Class distribution mismatch in semi-supervised learning.
method MixMOOD uses deep dataset dissimilarity measures to select unlabelled data.
result MixMOOD selects unlabelled data based on strong correlation with MixMatch accuracy.
Proposes PUUPL for PUL in imbalanced datasets, boosting minority class signals.
problem Imbalanced datasets and model calibration in PUL.
method Uncertainty-aware pseudo-labeling procedure (PUUPL).
result Substantial performance gains in highly imbalanced settings.
We consider the problem of estimating the class prior in an unlabeled dataset. Under the assumption that an additional labeled dataset is available, the class prior can be estimated by fitting a mixture of class-wise data distributions to the unlabeled data distribution. However, in practice, such an additional labeled…
Knowledge distillation is a widely used technique for model compression. We posit that the teacher model used in a distillation setup, captures relationships between classes, that extend beyond the original dataset. We empirically show that a teacher model can transfer this knowledge to a student model even on an {\it …
StyleDiff compares unlabeled datasets using disentangled image spaces.
problem Mismatches between development and real-world datasets lead to inaccurate predictions.
method Uses disentangled image spaces and focuses on attributes to compare datasets.
result Accurately detects and presents differences between datasets.
Deep RL detects anomalies from few labeled examples and large unlabeled data.
problem Anomaly detection with limited labeled data and large unlabeled data.
method Deep reinforcement learning to optimize detection of labeled and unlabeled anomalies.
result Significantly outperforms state-of-the-art methods on 48 real-world datasets.
New methods learn from PU data with non-representative positives.
problem Learning from PU data with non-representative positive classes.
method Integrates negative-unlabeled and unlabeled-unlabeled learning, or uses a recursive risk estimator.
result Effective across various real-world datasets and forms of positive bias.
Compressing giant neural networks has gained much attention for their extensive applications on edge devices such as cellphones. During the compressing process, one of the most important procedures is to retrain the pre-trained models using the original training dataset. However, due to the consideration of security, p…
This paper considers a semi-supervised learning framework for weakly labeled polyphonic sound event detection problems for the DCASE 2019 challenge's task4 by combining both the tri-training and adversarial learning. The goal of the task4 is to detect onsets and offsets of multiple sound events in a single audio clip. …
Prevents sensitive data generation in diffusion models using labeled and unlabeled data.
problem Generating sensitive data in diffusion models using unlabeled data.
method Positive-Unlabeled Diffusion Models, approximating ELBO with labeled and unlabeled data.
result Prevents the generation of sensitive data without compromising image quality.
Paper tackles leveraging unlabeled data for PU classification and robust generation.
problem Scarcity of labeled data in machine learning problems.
method Introduces a novel training framework that simultaneously targets PU classification and conditional generation using extra unlabeled data.
result Proves the effectiveness of a Classifier-Noise-Invariant Conditional GAN (CNI-CGAN) that enhances PU classifier performance and leverages extra data.
Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This result is a key hurdle in the deployment of robust machine learning models in many re…
Deep neural networks (DNNs) are incredibly brittle due to adversarial examples. To robustify DNNs, adversarial training was proposed, which requires large-scale but well-labeled data. However, it is quite expensive to annotate large-scale data well. To compensate for this shortage, several seminal works are utilizing l…
Improves anomaly detection with contaminated unlabeled data.
problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.
Enhances U-statistics for semi-supervised datasets using unlabeled data.
problem Efficiently utilizing unlabeled data in semi-supervised settings.
method Semi-supervised U-statistics enhanced by unlabeled data.
result Proposed method is asymptotically Normal and more efficient than classical U-statistics.
The recently proposed unlabeled-unlabeled (UU) classification method allows us to train a binary classifier only from two unlabeled datasets with different class priors. Since this method is based on the empirical risk minimization, it works as if it is a supervised classification method, compatible with any model and …
Paper proposes a method to extract style features from unlabeled data.
problem Extracting fine-grained features like styles from unlabeled data.
method Contrastive conditioned variational autoencoders with mutual information constraints.
result The method efficiently extracts style features from real-world natural image datasets.
Bayesian framework uses unlabeled data to improve fairness assessment.
problem Reliable fairness assessment with limited labeled data.
method Hierarchical latent variable model with Bayesian inference.
result Significant reduction in estimation error for fairness metrics.
BetaDataWeighter learns weights for unlabelled data to improve self-supervised learning accuracy.
problem Improving unsupervised representations with domain shift between unlabelled and target data.
method Learning Bayesian instance weights for unlabelled data to prioritize useful instances.
result BetaDataWeighter achieves highest average accuracy and prunes up to 78% of images without significant loss in accuracy.
Proposes a method to classify binary data from multiple unlabeled datasets.
problem High annotation costs in training classifiers from weakly supervised data.
method Introduces surrogate set classification (SSC) to predict data origin from multiple unlabeled datasets, then uses this to train a binary classifier.
result Demonstrates superior performance compared to existing methods.
Surveying how to use unlabeled data in federated learning.
problem Costly labeling of data limits FL applications.
method Survey and analyze existing research.
result Potential for using unlabeled data in FL.
WILDS 2.0 expands benchmark datasets for unsupervised adaptation.
problem Leveraging unlabeled data for distribution shifts in real-world applications.
method Curated unlabeled data across various applications, tasks, and modalities.
result State-of-the-art methods perform poorly on WILDS datasets.
Research improves open-set learning by leveraging unlabelled data.
problem Learning between observed and unobserved novel categories.
method Unified policy of positive and unlabelled learning, semi-supervised learning, and open-set recognition.
result Achieves state-of-the-art results in open-set learning.
Enhances few-shot image classification using unlabelled examples.
problem Few-shot image classification with limited labeled data.
method Transductive meta-learning combining soft k-means clustering and neural feature extractor.
result State-of-the-art performance on Meta-Dataset, mini-ImageNet, and tiered-ImageNet benchmarks.
Enhances adversarial robustness with unlabeled out-of-domain data.
problem Improving robustness of models against adversarial attacks.
method Leveraging unlabeled data from multiple domains to bridge the sample complexity gap in adversarial robustness.
result Better adversarial robustness achieved when unlabeled data comes from a shifted domain.
Existing algorithms aiming to learn a binary classifier from positive (P) and unlabeled (U) data generally require estimating the class prior or label noises ahead of building a classification model. However, the estimation and classifier learning are normally conducted in a pipeline instead of being jointly optimized.…
TAP transfers knowledge from unlabeled data to improve cross-modal learning.
problem Improving supervised learning performance using unlabeled data from a different modality.
method Probabilistic approach for missing information estimation, kernel regression, cross-attention module, TAP neural network.
result TAP significantly improves generalization across different domains and neural network architectures.
In-context learning solves PU classification without iterative optimization.
problem Binary classification with only labeled positives and unlabeled samples.
method Pretrained transformer (PUICL) that learns from synthetic PU datasets.
result Outperforms four standard PU learning baselines on 20 benchmarks.
DoubleMatch combines pseudo-labeling with self-supervision for SSL.
problem Lack of effective use of unlabeled data in SSL.
method Combines pseudo-labeling with self-supervised loss.
result Achieves state-of-the-art accuracies on multiple datasets.
Discriminative clustering learns from both labeled and unlabeled data.
problem Clustering complex datasets with limited labeled data.
method Gradient-based stochastic training and optimal transport with entropic regularization.
result The method can learn feature representations even in fully unsupervised settings.
Recent work has shown that using unlabeled data in semi-supervised learning is not always beneficial and can even hurt generalization, especially when there is a class mismatch between the unlabeled and labeled examples. We investigate this phenomenon for image classification on the CIFAR-10 and the ImageNet datasets, …
ATC predicts target domain accuracy using only labeled and unlabeled data.
problem Predicting out-of-distribution performance with limited labeled data.
method Average Thresholded Confidence (ATC) method that learns a threshold on model confidence.
result ATC outperforms previous methods across various types of distribution shifts and datasets.
ADS filters data points for efficient batch active learning.
problem Efficiently selecting data points for annotation in parallel settings.
method Active Data Shapley (ADS) using the Shapley value of data.
result Significantly increases efficiency of active learning by 6x.
Semi-supervised learning uses unlabeled data to improve fairness without sacrificing accuracy.
problem Discrimination in machine learning models.
method Pseudo labeling, re-sampling, ensemble learning.
result Unlabeled data can help achieve a better balance between accuracy and fairness.
ORDisCo learns from unlabeled data to improve semi-supervised continual learning.
problem Lack of effective use of unlabeled data in semi-supervised continual learning.
method Deep Online Replay with Discriminator Consistency (ORDisCo) that continually passes the learned data distribution to a classifier and selectively stabilizes discriminator parameters.
result Significant performance improvement on various semi-supervised learning benchmark datasets.
New framework assesses value of labeled vs unlabeled data in latent variable models.
problem Determining the optimal use of labeled and unlabeled data in latent variable models.
method Developed a bias-variance decomposition of the generalization error for method-of-moments latent variable estimation, and introduced a correction for misspecification.
result Labeled data is more valuable than unlabeled data when models are misspecified, but this value can be reduced with correction.
Existing methods for CWS usually rely on a large number of labeled sentences to train word segmentation models, which are expensive and time-consuming to annotate. Luckily, the unlabeled data is usually easy to collect and many high-quality Chinese lexicons are off-the-shelf, both of which can provide useful informatio…
This paper proposes a semi-conditional normalizing flow model for semi-supervised learning. The model uses both labelled and unlabeled data to learn an explicit model of joint distribution over objects and labels. Semi-conditional architecture of the model allows us to efficiently compute a value and gradients of the m…
Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a new algorithm, MixMatch, that works by guessing low-entropy labels for data-aug…
Proposes a few-shot learning method for feature selection without labeled data.
problem Feature selection in unlabeled data with limited instances.
method Uses Concrete random variables and permutation-invariant neural networks to select features from multiple source tasks.
result Outperforms existing methods in feature selection performance.
We investigate probabilistic decoupling of labels supplied for training, from the underlying classes for prediction. Decoupling enables an inference scheme general enough to implement many classification problems, including supervised, semi-supervised, positive-unlabelled, noisy-label and suggests a general solution to…
Study improves treatment effect estimation using unlabeled covariates.
problem Estimating treatment effects with limited labeled data.
method Developed efficiency bounds and estimators for semi-supervised setting.
result Estimators using unlabeled covariates have lower asymptotic variance.
Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark tasks. However, we argue that these benchmarks fail to address many issues that th…
Model predicts future term connections in biomedical research.
problem Capturing temporal dynamics and unobserved connections in biomedical term relationships.
method Variational inference model for positive-unlabeled learning on dynamic graphs.
result Model effectively predicts term relationships in real-world datasets.
Improves PU learning for imbalanced data with practical AUL estimation and new training method.
problem Training binary classifiers on datasets with only positive and unlabeled samples.
method Asymptotic unbiased AUL estimation and ProbTagging for imbalanced data.
result ProbTagging increases AUC by up to 10% on industrial and artificial data sets.
New method uses unlabeled data to improve robust learning models.
problem Current DRL formulations are too broad, leading to unreliable predictions.
method Incorporates unlabeled data to constrain the adversary in DRL.
result New formulation yields tighter performance guarantees and effective classifiers.