arXiv research

Proposes a new framework for learning from labeled and unlabeled data.

Boosting with unlabeled data achieves optimal sample complexity in agnostic settings.

Generative model creates synthetic unlabeled data for SSL.

Improves PU learning for imbalanced data with practical AUL estimation and new training method.

Enhances adversarial robustness with unlabeled out-of-domain data.

Positive-Unlabeled (PU) learning is an analog to supervised binary classification for the case when only the positive sample is clean, while the negative sample is contaminated with latent instances of positive class and hence can be considered as an unlabeled mixture. The objectives are to classify the unlabeled sampl…

LoD improves model safety by integrating unlabeled wild data, reducing OOD misclassification.

A semi-supervised learning method using predefined class centroids for image classification.

A new method for domain generalization using unlabeled data.

The positive-unlabeled (PU) classification is a common scenario in real-world applications such as healthcare, text classification, and bioinformatics, in which we only observe a few samples labeled as "positive" together with a large volume of "unlabeled" samples that may contain both positive and negative samples. Bu…

New method uses unlabeled data to estimate intercept in case-control logistic regression.

When learning a mapping from an input space to an output space, the assumption that the sample distribution of the training data is the same as that of the test data is often violated. Unsupervised domain shift methods adapt the learned function in order to correct for this shift. Previous work has focused on utilizing…

MTL method uses unlabeled data with pseudo labels to improve classification with disjoint datasets.

Active learning selects most informative unlabeled samples for labeling.

LACD uses unlabeled data to improve conditional diffusion models.

Curriculum Labeling improves semi-supervised learning with pseudo-labeling, achieving high accuracy with minimal labeled data.

Study improves treatment effect estimation using unlabeled covariates.

We consider the problem of estimating the class prior in an unlabeled dataset. Under the assumption that an additional labeled dataset is available, the class prior can be estimated by fitting a mixture of class-wise data distributions to the unlabeled data distribution. However, in practice, such an additional labeled…

In the early history of positive-unlabeled (PU) learning, the sample selection approach, which heuristically selects negative (N) data from U data, was explored extensively. However, this approach was later dominated by the importance reweighting approach, which carefully treats all U data as N data. May there be a new…

Estimates class prior for unlabeled data using kernel embedding.

Medix uses the median to detect outliers from unlabeled data for robust OOD detection.

Assessing the performance of a learned model is a crucial part of machine learning. However, in some domains only positive and unlabeled examples are available, which prohibits the use of most standard evaluation metrics. We propose an approach to estimate any metric based on contingency tables, including ROC and PR cu…

We consider an active learning setting where the algorithm has access to a large pool of unlabeled data and a small pool of labeled data. In each iteration, the algorithm chooses few unlabeled data points and obtains their labels from an oracle. In this paper, we consider a probabilistic querying procedure to choose th…

Framework uses unlabeled out-of-domain data to improve semi-supervised classification.

In this work, we propose a simple yet effective semi-supervised learning approach called Augmented Distribution Alignment. We reveal that an essential sampling bias exists in semi-supervised learning due to the limited number of labeled samples, which often leads to a considerable empirical distribution mismatch betwee…

EAGC boosts GCD by regulating gradient entanglement, improving known and novel category separability.

Research improves open-set learning by leveraging unlabelled data.

GPNs use unlabeled data to estimate uncertainty in Bayesian problems.

Study public-data assisted private stochastic optimization with labeled or unlabeled public data.

A new method for PU learning improves classification error on CIFAR-10.

Transductive learning considers a training set of $m$ labeled samples and a test set of $u$ unlabeled samples, with the goal of best labeling that particular test set. Conversely, inductive learning considers a training set of $m$ labeled samples drawn iid from $P(X,Y)$, with the goal of best labeling any future sample…

In recent years, the softmax model and its fast approximations have become the de-facto loss functions for deep neural networks when dealing with multi-class prediction. This loss has been extended to language modeling and recommendation, two fields that fall into the framework of learning from Positive and Unlabeled d…

In-context learning solves PU classification without iterative optimization.

We propose a general semi-supervised inference framework focused on the estimation of the population mean. As usual in semi-supervised settings, there exists an unlabeled sample of covariate vectors and a labeled sample consisting of covariate vectors along with real-valued responses ("labels"). Otherwise, the formulat…

ORDisCo learns from unlabeled data to improve semi-supervised continual learning.

In this paper, we study the recovery of a signal from a set of noisy linear projections (measurements), when such projections are unlabeled, that is, the correspondence between the measurements and the set of projection vectors (i.e., the rows of the measurement matrix) is not known a priori. We consider a special case…

Compressing giant neural networks has gained much attention for their extensive applications on edge devices such as cellphones. During the compressing process, one of the most important procedures is to retrain the pre-trained models using the original training dataset. However, due to the consideration of security, p…

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can be beneficial in such settings and can reduce the number of true labels require…

In conventional domain adaptation, a critical assumption is that there exists a fully labeled domain (source) that contains the same label space as another unlabeled or scarcely labeled domain (target). However, in the real world, there often exist application scenarios in which both domains are partially labeled and n…

Active learning selects samples for labeling to build accurate models with minimal labeled data.

A new method predicts true classes from positive and unlabeled data with additional labeled observations.

SAL framework uses unlabeled data to improve OOD detection.

Algorithm recovers multiple low-rank matrices from unlabeled data.

Algorithm learns multiple LDS models from unlabeled short trajectories.

iRDM selects unlabeled samples for regression without labels, improving model accuracy.

Semi-supervised learning improves classification in high dimensions.

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large stream of unlabeled data easily obtainable in the wild. In particular, we design a n…

New method debiases selection bias in PU classification with exposure data.