Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2515037541,005 · Jun 202019922001200920172026
48 results for algorithmic supervision

Paper proposes an algorithm to recover full supervision from weakly labeled data.

problem Machine learning requires expensive data annotation, motivating the use of weak supervision.
method The paper introduces a disambiguation principle and an empirical disambiguation algorithm for partial labelling.
result The algorithm achieves exponential convergence rates under learnability assumptions.

New algorithm improves source separation with multi-trial supervision.

problem Non-convex optimization and interpretability of independent components.
method Proximal gradient-type algorithm in invertible matrices with backpropagation for joint learning.
result Increased success rate of non-convex optimization and improved interpretability.

Semi-supervised learning can't outperform supervised learning for 2-Gaussian mixture models.

problem Can semi-supervised learning algorithms improve over supervised learning?
method Deriving a tight lower bound for 2-Gaussian mixture models.
result No SSL algorithm can improve upon the minimax-optimal statistical error rates of supervised or unsupervised learning for these distributions.

Is all of machine learning supervised to some degree? The field of machine learning has traditionally been categorized pedagogically into supervised vs unsupervised learningsupervised~vs~unsupervised~learning; where supervised learning has typically referred to learning from labeled data, while unsupervised learning has typically referred to learning …

2019-04-05abs ↗pdf ↗

The Yarowsky algorithm is a rule-based semi-supervised learning algorithm that has been successfully applied to some problems in computational linguistics. The algorithm was not mathematically well understood until (Abney 2004) which analyzed some specific variants of the algorithm, and also proposed some new algorithm…

2012-06-20abs ↗pdf ↗

As machine learning algorithms become increasingly sophisticated to exploit subtle features of the data, they often become more dependent on simulations. This paper presents a new approach called weakly supervised classification in which class proportions are the only input into the machine learning algorithm. Using on…

2017-02-01abs ↗pdf ↗

Paper resolves the debate on process vs. outcome supervision in reinforcement learning.

problem Distinguishing between process and outcome supervision in reinforcement learning.
method Developed a technical tool (Change of Trajectory Measure Lemma) to show equivalence between outcome and process supervision under standard data coverage assumptions.
result Reinforcement learning through outcome supervision is statistically equivalent to process supervision, up to polynomial factors in horizon.

We propose a novel sparse preference learning/ranking algorithm. Our algorithm approximates the true utility function by a weighted sum of basis functions using the squared loss on pairs of data points, and is a generalization of the kernel matching pursuit method. It can operate both in a supervised and a semi-supervi…

2013-07-02abs ↗pdf ↗

New attacks prevent both supervised and contrastive learning from private data.

problem Preventing unauthorized use of private data and commercial datasets.
method Contrastive-like data augmentations in supervised error minimization or maximization frameworks.
result Achieve state-of-the-art worst-case unlearnability across SL and CL algorithms.

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as such have been widely employed in the semi-supervised learning. In this paper we…

2016-12-06abs ↗pdf ↗

Paper analyzes self-supervised image denoising with denatured data.

problem Understanding the performance of self-supervised image denoising with denatured data.
method Theoretical analysis and numerical experiments on a denoising algorithm.
result Theoretical analysis shows the algorithm finds desired solutions to the optimization problem.

Semi-supervised clustering methods incorporate a limited amount of supervision into the clustering process. Typically, this supervision is provided by the user in the form of pairwise constraints. Existing methods use such constraints in one of the following ways: they adapt their clustering procedure, their similarity…

2016-09-23abs ↗pdf ↗

We introduce a semi-supervised discrete choice model to calibrate discrete choice models when relatively few requests have both choice sets and stated preferences but the majority only have the choice sets. Two classic semi-supervised learning algorithms, the expectation maximization algorithm and the cluster-and-label…

2017-02-16abs ↗pdf ↗

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of crowdsourced data. In this paper, we propose a supervised collective classificatio…

2015-07-23abs ↗pdf ↗

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making small perturbations to numerous entries of the input vector, which is inappropriat…

2016-05-25abs ↗pdf ↗

Supervised machine learning (ML) algorithms are aimed at maximizing classification performance under available energy and storage constraints. They try to map the training data to the corresponding labels while ensuring generalizability to unseen data. However, they do not integrate meaning-based relationships among la…

2019-05-29abs ↗pdf ↗

New algorithm for safer machine learning with different testing and training distributions.

problem Challenges in modern machine learning where training and testing distributions differ.
method First-order optimization algorithm for superquantile-based learning.
result Promising numerical results show the approach's effectiveness.

We introduce Negative Sampling in Semi-Supervised Learning (NS3L), a simple, fast, easy to tune algorithm for semi-supervised learning (SSL). NS3L is motivated by the success of negative sampling/contrastive estimation. We demonstrate that adding the NS3L loss to state-of-the-art SSL algorithms, such as the Virtual Adv…

2019-11-12abs ↗pdf ↗

Within the framework of statistical learning theory it is possible to bound the minimum number of samples required by a learner to reach a target accuracy. We show that if the bound on the accuracy is taken into account, quantum machine learning algorithms for supervised learning---for which statistical guarantees are …

2020-01-28abs ↗pdf ↗

Paper proposes a novel GCN-based SSL algorithm to enhance node representations using contrastive and generative losses.

problem Shortage of supervision in graph-based semi-supervised learning.
method Combines contrastive and generative graph convolutional networks to enrich supervision signals.
result Improves node representations and classification results on various real-world datasets.

New algorithm robustly trains deep neural networks under corrupted supervision.

problem Training deep neural networks with corrupted supervision data.
method Unified framework for classification and regression, focusing on collective impact of data points on average gradient.
result Achieves strong guarantees without assuming the type of corruption, robust under various types of corruption.

Study of online learning for structured prediction problems.

problem Structured prediction in online learning settings.
method Developed algorithms for structured prediction in online learning, generalizing from supervised learning.
result Achieved the same excess risk upper bound for non-i.i.d. data and bounded the stochastic regret for non-stationary data.

New algorithm tackles regression on manifold data using diffusion and semi-supervised learning.

problem Regression on high-dimensional manifold data with complex structures.
method Diffusion-based spectral algorithm using graph Laplacian and heat kernel.
result Algorithm achieves convergence rate dependent on intrinsic manifold dimension, avoiding curse of dimensionality.

Proposes a framework to balance supervised and unsupervised learning using random matrix theory.

problem Balancing supervised and unsupervised learning in high-dimensional data.
method QLDS model with quadratic margin maximization under low density separation assumption.
result Establishes a smooth bridge between supervised and unsupervised learning methods.

Paper presents a probabilistic diagnostic model for identifying and treating supervised learning degradation issues.

problem Degradation problems in supervised learning, including class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness.
method Develops a novel probabilistic diagnostic model to identify and treat degradation issues in supervised learning.
result Early and correct diagnosis of degradation issues allows for selecting appropriate remediation treatments and unbiased performance metrics.

Traditionally, practitioners initialize the {\tt k-means} algorithm with centers chosen uniformly at random. Randomized initialization with uneven weights ({\tt k-means++}) has recently been used to improve the performance over this strategy in cost and run-time. We consider the k-means problem with semi-supervised inf…

2016-02-01abs ↗pdf ↗