Differentiable Greedy Networks improve sentence selection for claim verification.
problem Optimal selection of sentences for claim verification in FEVER task.
method Proposes a trainable subset selection algorithm based on submodular optimization and unfolds a greedy algorithm into a computational graph.
result Differentiable Greedy Network (DGN) outperforms other methods in precision and recall.
Online learning improves dengue fever detection with minimal training data.
problem Improving dengue fever detection accuracy with limited training data.
method Online learning approach for incremental learning from patient symptoms and diagnostic investigations.
result The proposed model effectively identifies patients with high likelihood of dengue disease.
Identification of the influential clinical symptoms and laboratory features that help in the diagnosis of dengue fever in early phase of the illness would aid in designing effective public health management and virological surveillance strategies. Keeping this as our main objective we develop in this paper, a new compu…
GEAR uses graphs to integrate and reason over multiple evidence for fact verification.
problem Fact verification requires integrating and reasoning over multiple pieces of evidence.
method GEAR employs a graph-based framework to transfer information among evidence and uses BERT for improved performance.
result GEAR achieves a promising test FEVER score of 67.10% on a large-scale benchmark dataset.
Proposes a new approach to improve disease prediction by considering who generates the data.
problem Improving disease prediction across different datasets considering who generates the data.
method Formulates domain adaptation as a multi-source hierarchical Bayesian framework.
result Improves prediction accuracy in target datasets with largely unlabelled data.
Improves flu prediction by blending environment and population info.
problem Challenges in using data from one environment in another due to feature variability and population subgroup differences.
method Population-aware hierarchical Bayesian domain adaptation framework with multiple invariant components.
result Model improves flu prediction in new environments with unlabelled data.
The study quantifies Brexit risk using SABR dynamics and Bayesian methods.
problem Measuring tail risk in EUR-GBP options related to Brexit.
method Data-driven statistical indicator, lognormal SABR dynamics, Bayesian estimation, inverse calibration problem, Markov chain Monte Carlo.
result A closed-form expression for the martingale defect quantifying tail risk.
SFAVEL distills features from language models for fact verification without annotations.
problem Fact verification with semantically meaningful and compact features.
method Self-supervised pretraining using contrastive loss with language models.
result Achieved state-of-the-art results on FB15k-237 and FEVER.
Transformers for binary decisions are sensitive to evidence order, leading to unreliable outcomes.
problem Order sensitivity in Transformers for binary decisions leads to unreliable outcomes.
method Formalized an expectation-realization gap and developed QMV and EDFL bounds.
result Uniform permutation mixtures reduce dispersion and improve reliability.
Machine learning model diagnoses COVID-19 from routine blood tests.
problem Difficulty in diagnosing COVID-19 due to inconsistent blood parameter changes.
method Constructed a machine learning model using 5,333 patients with various infections and 160 COVID-19-positive patients.
result Cross-validated AUC of 0.97, sensitivity of 81.9%, specificity of 97.9%.
This paper reviews dMTL and methods for selecting auxiliary tasks.
problem Improving model performance for multiple tasks.
method Review of dMTL approaches and methods for selecting auxiliary tasks.
result Methods for selecting auxiliary tasks can improve dMTL performance.
APT-Gen generates tasks to help RL learn in hard problems.
problem Learning in hard exploration problems.
method APT-Gen uses a task generator to create tasks from a parameterized space, balancing performance and similarity to target tasks.
result APT-Gen outperforms baselines in grid world and robotic manipulation tasks.
OCEAN infers online task identities from context variables.
problem Online task inference for compositional tasks with context adaptation.
method Variational inference framework OCEAN models global and local context variables in a joint latent space.
result OCEAN provides more effective task inference with sequential context adaptation.
Deep RL multi-task learning outperforms single-task learning on new tasks.
problem Improving performance on new tasks in multi-task reinforcement learning.
method Investigation of multi-task reinforcement learning algorithms with and without Elastic Weight Consolidation (EWC).
result Multi-task reinforcement learning algorithms outperform single-task learning on new tasks.
Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to each other, hence it could be advantageous to transfer information only between …
Proposes a new method for clustering tasks in multi-task learning.
problem Improving performance of multiple related prediction tasks.
method Semisoft task clustering approach with a three-step algorithm.
result Validation of the proposed approach on synthetic and real-world datasets.
MBML improves multi-task RL by inferring task identity from state-action pairs.
problem Multi-task batch reinforcement learning with unseen tasks.
method MBML uses triplet loss and relabeling to robustify task inference.
result Significantly faster convergence on unseen tasks compared to random initialization.
Multi-task learning is a learning paradigm which seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this paper, we propose a regularization formulation for learning the relationships between tasks in multi-task learning. This formulation can be viewed as a n…
HydaLearn dynamically adjusts task weights for better MTL performance.
problem Constant loss weights in MTL lead to poor results due to drifting relevance and varying mini-batch composition.
method HydaLearn uses mini-batch gradients to dynamically adjust task weights.
result HydaLearn improves performance on synthetic and real-world data.
AutoSeM automatically selects and balances auxiliary tasks in MTL.
problem Choosing and balancing auxiliary tasks in MTL.
method AutoSeM uses a Beta-Bernoulli multi-armed bandit with Thompson Sampling for task selection and a Gaussian Process for learning the mixing ratio.
result AutoSeM achieves significant performance boosts on GLUE language understanding tasks.
New distance metric for neural architecture search reduces search space complexity.
problem Reducing the complexity of neural architecture search.
method Fisher task distance for measuring task similarity and online neural architecture search.
result Reduced search space complexity for task-specific architectures.
HGNN learns augmented features for deep multi-task learning.
problem Feature learning for deep multi-task learning.
method Hierarchical Graph Neural Network (HGNN) with two levels of graph neural networks.
result Significant performance improvement in classification tasks.
We investigate task clustering for deep-learning based multi-task and few-shot learning in a many-task setting. We propose a new method to measure task similarities with cross-task transfer performance matrix for the deep learning scenario. Although this matrix provides us critical information regarding similarity betw…
ST-MAML tackles task ambiguity in meta-learning by encoding tasks with stochastic representations.
problem Handling tasks from multiple distributions is challenging for meta-learning due to task ambiguity.
method ST-MAML uses a stochastic neural network module to encode tasks and propagate task representations to revise input variable encoding.
result ST-MAML matches or outperforms state-of-the-art methods on various tasks.
New algorithm combines curriculum learning with HER for complex object manipulation tasks.
problem Learning complex sequential object manipulation tasks from scratch is challenging.
method Curriculum learning with Hindsight Experience Replay (HER) for recurrent object manipulation tasks.
result Significant improvement in learning sequential object manipulation tasks compared to vanilla-HER.
Transformers infer tasks from context via two modes, geometrically shaped task vectors explain their behavior.
problem Understanding how transformers infer tasks from context and the geometric properties of task vectors.
method Synthetic setting to train small transformers, mathematical characterization of task-vector geometry and inference modes.
result Task-vector geometry shapes in-distribution and out-of-distribution behavior of transformers.
MTL-NAS combines NAS with GP-MTL for task-agnostic multi-task learning.
problem Designing architectures for diverse tasks with varying priors.
method Disentangled GP-MTL networks, hierarchical feature sharing, and gradient-based search.
result General-purpose model trained once can adapt to multiple tasks.
Meta-learning framework uses task similarity through nonparametric kernel regression.
problem Limited tasks and outliers/dissimilar tasks hinder meta-learning performance.
method Nonparametric kernel regression to quantify and use task similarity.
result Meta-learning algorithm outperforms existing methods in task-limited settings.
Novel meta-RL strategy improves efficiency in learning novel tasks.
problem Efficiency in learning novel tasks using deep RL.
method Decomposes meta-RL into task-exploration, task-inference, and task-fulfillment; uses deep networks and a task encoder.
result Improves sample efficiency and mitigates meta-overfitting.
RTE enables extrapolation to new tasks by learning task transformations.
problem Learning systems struggle to generalize to unseen tasks.
method Relational Task Extrapolator (RTE) learns task transformations to enable extrapolation.
result RTE substantially outperforms existing approaches on extrapolation tasks.
Study shows perceptual boost of visual attention varies with task difficulty and size.
problem Understanding how task-dependent the perceptual boost of visual attention is in natural settings.
method Designed and trained neural networks on various visual tasks, comparing results to baseline.
result Perceptual boost of attention is stronger with more difficult tasks and weaker with larger task sets.
New approach for multi-task reinforcement learning without task interference.
problem Efficient knowledge sharing between tasks in reinforcement learning.
method Attention-based multi-task deep reinforcement learning.
result Achieves positive knowledge transfer and avoids negative transfer.
Meta-RL learns shared and task-specific information for quick adaptation.
problem Data inefficiency and limited generalization in deep RL.
method Task embedding and shared policy learned via SGD meta-learner.
result 3 to 4 times higher returns on novel tasks compared to baselines.
Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces automated tasks, which exploit the sequential nature of the input data, as second…
Robot learns multiple tasks hierarchically by transferring knowledge.
problem Learning multiple complex tasks in open-ended environments.
method Task-oriented procedures, goal-babbling, imitation learning, active learning, intrinsic motivation.
result Robots can learn complex tasks more efficiently by transferring knowledge from simpler ones.
In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information across the tasks. We assume that each task parameter vector is a linear combi- nat…
Transformers can generalize to a large task family with only a few demonstrations.
problem Can learning from a small set of tasks generalize to a large task family?
method Investigating autoregressive compositional structure where each task is a composition of T T T operations, each from a finite family of D D D subtasks. result Transformers can generalize to D T D^T D T tasks with only O ~ ( D ) \widetilde{O}(D) O ( D ) demonstrations. Tool manipulation is vital for facilitating robots to complete challenging task goals. It requires reasoning about the desired effect of the task and thus properly grasping and manipulating the tool to achieve the task. Task-agnostic grasping optimizes for grasp robustness while ignoring crucial task-specific constrain…
Framework adapts to new tasks based on prior knowledge.
problem Models struggle to adapt to novel tasks without direct experience.
method Learned task representations and meta-mappings to transform them.
result Meta-mapping achieves 80-90% performance on novel tasks.
Gradient surgery improves multi-task learning efficiency.
problem Challenges in sharing structure across multiple tasks.
method Gradient projection onto normal plane of conflicting gradients.
result Substantial gains in efficiency and performance.
Method reweights auxiliary tasks to reduce data need for main task.
problem Limited labeled data for supervised learning.
method Formulates weighted likelihood function as surrogate prior, minimizing divergence to true prior.
result Effective use of limited labeled data with auxiliary tasks, improving performance.
SON-GOKU uses graph coloring to improve multi-task learning by partitioning tasks into compatible groups.
problem Gradient interference between conflicting multi-task learning objectives slows convergence and model performance.
method SON-GOKU computes gradient interference, constructs an interference graph, and applies greedy graph-coloring to partition tasks.
result SON-GOKU consistently outperforms baselines and state-of-the-art multi-task optimizers on six datasets.
Paper tackles graph class-incremental learning with task profiling and prompting.
problem Challenges in separating classes from different tasks in graph CIL.
method Laplacian smoothing-based task profiling and graph prompting approach.
result 100% task ID prediction accuracy and significant performance improvement.
Optimal task order improves continual learning performance.
problem Challenges in neural networks learning multiple tasks in sequence.
method Linear teacher-student model with latent factors, derived analytical expression.
result Two principles for optimal task order: least representative first and dissimilar adjacent tasks.
Paper presents IMRCs for evolving tasks with forward and backward learning.
problem Incremental learning of evolving tasks with few samples per task.
method Incremental minimax risk classifiers (IMRCs) that exploit forward and backward learning.
result IMRCs provide significant performance improvement, especially with reduced sample sizes.
Small parameterized towers improve multi-task learning efficiency and generalization.
problem Balancing Pareto efficiency and generalization in multi-task learning.
method Under-parameterized self-auxiliaries for multi-task models.
result Small parameterized towers enhance Pareto efficiency in various multi-task applications.
Single neural network learns multiple tasks from combined data.
problem Can a single neural network learn multiple unrelated tasks?
method Investigates how task representations affect joint learning; uses various task encoding methods.
result Single neural network can learn multiple tasks from combined data, even when tasks are unrelated and different.
Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during learning of new, disjoint knowledge. Here, we propose a new approach to sequential learning which leverages the recent discovery of adversari…