Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

162323485646 · Jun 202019922001200920172026
48 results for low labeling rates

Poisson learning improves graph-based semi-supervised learning at very low label rates.

problem Degeneracy of Laplacian semi-supervised learning at low label rates.
method Replaces label assignment with source and sink placement, solving Poisson equation.
result Provably more stable and informative predictions than Laplacian learning.

Study shows how Laplacian semi-supervised learning behaves at low labeling rates.

problem Understanding behavior of Laplacian semi-supervised learning at very low label rates.
method Analysis of random geometric graphs and ΓΓ-convergence tools.
result For certain conditions, Laplacian learning becomes degenerate and spikes form; for others, it remains well-posed and consistent.

New method improves false-/true-positive-rate estimation in fraud detection with noisy labels.

problem Estimating FPR/TPR in fraud detection with class-conditional label noise.
method Directly cleaning model's validation data to de-correlate cleaning error with model scores.
result Improves accuracy of FPR/TPR estimates, especially in asymmetric label noise scenarios.

A semi-supervised framework using stochastic interpolation and latent representations.

problem Challenges in conditional generative modeling with scarce labeled data.
method Combines conditional stochastic interpolation with low-dimensional latent representations.
result Significantly improves sample complexity and achieves faster convergence rate.

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network by softening the ground-truth labels in the training data in an attempt to penal…

2020-01-07abs ↗pdf ↗

The recently proposed self-ensembling methods have achieved promising results in deep semi-supervised learning, which penalize inconsistent predictions of unlabeled data under different perturbations. However, they only consider adding perturbations to each single data point, while ignoring the connections between data…

2017-11-01abs ↗pdf ↗

DM2L tackles missing labels in multi-label learning by modeling local and global rank structures.

problem Missing labels in multi-label learning.
method DM2L imposes local low-rank structures and global high-rank structures on predictions of instances from the same and different labels, respectively.
result DM2L outperforms state-of-the-art methods in multi-label learning with missing labels.

We analyze the local Rademacher complexity of empirical risk minimization (ERM)-based multi-label learning algorithms, and in doing so propose a new algorithm for multi-label learning. Rather than using the trace norm to regularize the multi-label predictor, we instead minimize the tail sum of the singular values of th…

2014-10-26abs ↗pdf ↗

Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict inductively on new users/movies. In this paper, we study the problem of inductive matr…

2013-06-04abs ↗pdf ↗

In many applications the process of generating label information is expensive and time consuming. We present a new method that combines active and semi-supervised deep learning to achieve high generalization performance from a deep convolutional neural network with as few known labels as possible. In a setting where a …

2018-03-03abs ↗pdf ↗

Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a new algorithm, MixMatch, that works by guessing low-entropy labels for data-aug…

2019-05-06abs ↗pdf ↗

Study semi-supervised learning with noisy proxy covariates, deriving bounds and showing gains.

problem Learning from noisy proxy covariates with scarce labels.
method Two-stage estimator learning kernel eigenfeatures from all proxy covariates and fitting a ridge predictor on labeled data.
result Finite sample bounds show fast labeled sample rates and consistent gains over supervised and semi-supervised baselines.

This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems. We suggest that for each individual label, it cannot only be implicitly connected with other labels via the low-rank constraint over label predictors, but also its performa…

2017-01-25abs ↗pdf ↗

We solve robust regression and matrix completion problems with sparse and low-rank models.

problem Adversarial contamination and noisy matrix completion in high-dimensional settings.
method Subgaussian statistical learning framework, trace-regression with matrix decomposition, novel Huber-type loss.
result Near-optimal estimation rates for robust regression and matrix completion.

The paper analyzes matrix completion with unlabeled implicit feedback and provides error bounds.

problem Matrix completion with shared low-rank ground truth and sampling distribution.
method Combining subspace recovery theory and matrix completion bounds.
result Error bounds showing contributions from estimating the sampling distribution and ground truth.

A new method for active learning works well across all label budgets.

problem Active learning methods perform poorly in both low and high label budgets.
method Uncertainty Herding: a simple, computationally fast method that optimizes uncertainty coverage.
result Uncertainty Herding nearly optimizes distribution-level coverage and performs well across various active learning tasks.

Adding uninformative labels improves tumor segmentation in low-data mammography.

problem Improving tumor segmentation in mammography with limited data.
method Used seemingly uninformative labels from non-expert annotators to turn a multi-label task into a multi-class problem.
result Performance gains in tumor segmentation are achieved in low-data settings with additional uninformative labels.

Learning a classifier with control on the false-positive rate plays a critical role in many machine learning applications. Existing approaches either introduce prior knowledge dependent label cost or tune parameters based on traditional classifiers, which lack consistency in methodology because they do not strictly adh…

2018-01-15abs ↗pdf ↗

Semi-supervised EM improves convergence rate with labeled samples.

problem Improving convergence rate in EM algorithm with labeled and unlabeled data.
method Analysis of semi-supervised EM algorithm for Gaussian mixture models.
result Labeled samples significantly improve the convergence rate for the EM algorithm.

This paper reports on our analysis of the 2011 CAMRa Challenge dataset (Track 2) for context-aware movie recommendation systems. The train dataset comprises 4,536,891 ratings provided by 171,670 users on 23,974$ movies, as well as the household groupings of a subset of the users. The test dataset comprises 5,450 rating…

2012-07-26abs ↗pdf ↗

The objective in extreme multi-label learning is to train a classifier that can automatically tag a novel data point with the most relevant subset of labels from an extremely large label set. Embedding based approaches make training and prediction tractable by assuming that the training label matrix is low-rank and hen…

2015-07-09abs ↗pdf ↗

Algorithm learns from both labeled and arbitrary test examples, giving guarantees for bounded VC dimension classes.

problem Learning from arbitrary test examples, not just perturbations.
method Selective transductive learning algorithm that outputs abstaining predictions.
result Nontrivial guarantees for bounded VC dimension classes with arbitrary train and test distributions.

RegMixMatch optimizes Mixup for semi-supervised learning by integrating high- and low-confidence samples.

problem Mixup degrades SSL performance by compromising artificial labels purity.
method RegMixMatch integrates high- and low-confidence samples, uses class-aware Mixup, and mitigates confirmation bias.
result RegMixMatch achieves state-of-the-art performance in SSL benchmarks.

We study generalization properties of weakly supervised learning. That is, learning where only a few "strong" labels (the actual target of our prediction) are present but many more "weak" labels are available. In particular, we show that having access to weak labels can significantly accelerate the learning rate for th…

2020-02-19abs ↗pdf ↗

This paper proposes Relational Similarity Machines (RSM): a fast, accurate, and flexible relational learning framework for supervised and semi-supervised learning tasks. Despite the importance of relational learning, most existing methods are hard to adapt to different settings, due to issues with efficiency, scalabili…

2016-08-02abs ↗pdf ↗

New methods identify local clusters in graphs with few labels.

problem Identifying specific substructures in large graphs without additional structural information.
method Random sampling, diffusion, and overlap analysis of local clusters.
result Proves the correctness of the proposed methods and achieves state-of-the-art results.

The paper tackles noisy labels in high-dimensional data, showing low-dimensional intuitions fail and proposing an optimized method.

problem Noisy labels in high-dimensional data classification.
method Linear classifier with a label noisiness aware loss function, using random matrix theory and Gaussian mixture data model.
result The performance of the linear classifier in high-dimension converges to a limit involving scalar statistics of the data, and the optimal classifier in low-dimension fails.

SGD handles label noise with bounds improving over SGLD.

problem Label noise in non-convex optimization.
method Stochastic gradient descent with uniform dissipativity and smoothness conditions, using Wasserstein distance and algorithmic stability.
result Generalization error bounds with a rate of n2/3n^{-2/3}, better than SGLD's n1/2n^{-1/2}.