arXiv research

Adversarial robust learning improved for transductive setting.

In this paper we introduce the transductive linear bandit problem: given a set of measurement vectors $\mathcal{X}\subset \mathbb{R}^d$, a set of items $\mathcal{Z}\subset \mathbb{R}^d$, a fixed confidence $δ$, and an unknown vector $θ^{\ast}\in \mathbb{R}^d$, the goal is to infer $\text{argmax}_{z\in \mathcal{Z}} z^\t…

Standard methods in supervised learning separate training and prediction: the model is fit independently of any test points it may encounter. However, can knowledge of the next test point $\mathbf{x}_{\star}$ be exploited to improve prediction accuracy? We address this question in the context of linear prediction, show…

The paper establishes bounds for transductive learning using information theory.

Improved bounds for unbounded losses using transductive priors.

Proposes a transductive matrix completion method with calibration for multi-task learning.

Paper proposes PSIPS for identifying Pareto set with correlated objectives.

Transductive learning considers a training set of $m$ labeled samples and a test set of $u$ unlabeled samples, with the goal of best labeling that particular test set. Conversely, inductive learning considers a training set of $m$ labeled samples drawn iid from $P(X,Y)$, with the goal of best labeling any future sample…

The paper finds a fundamental trade-off between confidence and efficiency in transductive conformal prediction.

Improved mistake bounds for transductive online learning.

Multi-group learners suffer a penalty in transductive learning.

New method TLC improves transductive learning bounds.

Transductive learning considers situations when a learner observes $m$ labelled training points and $u$ unlabelled test points with the final goal of giving correct answers for the test points. This paper introduces a new complexity measure for transductive learning called Permutational Rademacher Complexity (PRC) and …

We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have broad applications in learning theory in general, we exemplify their significance by studying the t…

Improved few-shot learning with LSSVM and transductive modules.

IDS algorithm optimizes sequential decisions in various monitoring settings.

Most traditional online learning algorithms are based on variants of mirror descent or follow-the-leader. In this paper, we present an online algorithm based on a completely different approach, tailored for transductive settings, which combines "random playout" and randomized rounding of loss subgradients. As an applic…

We develop a technique for deriving data-dependent error bounds for transductive learning algorithms based on transductive Rademacher complexity. Our technique is based on a novel general error bound for transduction in terms of transductive Rademacher complexity, together with a novel bounding technique for Rademacher…

New method improves transductive learning predictions with multiplicative oracle inequalities.

TIM maximizes mutual information for few-shot learning, outperforming state-of-the-art methods.

Graph neural networks generalize well under certain conditions, explained by learning theory.

We consider using an ensemble of binary classifiers for transductive prediction, when unlabeled test data are known in advance. We derive minimax optimal rules for confidence-rated prediction in this setting. By using PAC-Bayes analysis on these rules, we obtain data-dependent performance guarantees without distributio…

New bounds improve graph node classification using optimal transport.

Study shows transductive learning is equivalent to PAC learning for most natural loss functions.

A new method for few-shot learning using Laplacian regularization.

Local regularization fails in transductive learning for some multiclass problems.

Combines Xgboost and transductive SVM for semi-supervised learning.

Unsupervised domain adaptation (UDA) amounts to assigning class labels to the unlabeled instances of a dataset from a target domain, using labeled instances of a dataset from a related source domain. In this paper, we propose to cast this problem in a game-theoretic setting as a non-cooperative game and introduce a ful…

In few-shot classification, the aim is to learn models able to discriminate classes using only a small number of labeled examples. In this context, works have proposed to introduce Graph Neural Networks (GNNs) aiming at exploiting the information contained in other samples treated concurrently, what is commonly referre…

Extractive compression is a challenging natural language processing problem. This work contributes by formulating neural extractive compression as a parse tree transduction problem, rather than a sequence transduction task. Motivated by this, we introduce a deep neural model for learning structure-to-substructure tree …

Study on tradeoffs between mistakes and ERM oracle calls in online and transductive learning.

New algorithm tackles multiclass transductive online learning with unbounded labels.

New algorithm identifies best arm in semiparametric bandits with near optimal efficiency.

Proposes a framework for compositional generalization in language models.

Many machine learning tasks can be expressed as the transformation---or \emph{transduction}---of input sequences into output sequences: speech recognition, machine translation, protein secondary structure prediction and text-to-speech to name but a few. One of the key challenges in sequence transduction is learning to …

Enhances few-shot image classification using unlabelled examples.

New methods learn from single graphs, improving transductive node classification.

Meta-learning framework improves model performance on few-shot classification tasks.

GCL-LRR improves node classification in noisy graphs.

The paper surveys recent extensions of the Long-Short Term Memory networks to handle tree structures from the perspective of learning non-trivial forms of isomorph structured transductions. It provides a discussion of modern TreeLSTM models, showing the effect of the bias induced by the direction of tree processing. An…

Algorithm predicts with optimal loss by abstaining from uncertain test examples.

Optimizes pure exploration in linear bandits with a new algorithm.

PAC learning simplified as bipartite matching.

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to combinatorial explosion of the sample space, TBMs overcome the problem by adaptively …

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain shift between the training and the test data distribution. In this regard, unsup…

Training-free GNNs use labels as features to improve node classification.

Given a hypothesis space, the large volume principle by Vladimir Vapnik prioritizes equivalence classes according to their volume in the hypothesis space. The volume approximation has hitherto been successfully applied to binary learning problems. In this paper, we extend it naturally to a more general definition which…

The goal of few-shot learning is to learn a classifier that generalizes well even when trained with a limited number of training instances per class. The recently introduced meta-learning approaches tackle this problem by learning a generic classifier across a large number of multiclass classification tasks and general…