This work improves multi-task regression performance using approximations of full-conformal prediction.
problem Jointly solve multiple regression tasks with better performance than individual tasks.
method Design an approximating prediction region in RKHS for full-conformal multi-task regression.
result The approximating prediction region improves upon split-conformal prediction on synthetic data.
Develops a scalable multi-task Gaussian process with neural embedding for improved performance.
problem High model complexity and limited model capability in multi-task Gaussian processes.
method Neural embedding of coregionalization, advanced variational inference, sparse approximation.
result Higher prediction quality and better generalization of the NSVLMC model.
The paper uses random matrix theory for multi-task regression, improving time series forecasting.
problem Improving time series forecasting using multi-task regression.
method Applying random matrix theory to multi-task regression problems, deriving closed-form solutions for optimization.
result Provides a robust foundation for hyperparameter optimization in multi-task regression scenarios.
MUMBO optimizes multiple tasks efficiently, even with low-cost related functions.
problem Efficiently optimizing multiple related functions with low-cost evaluations.
method Derives a novel multi-task version of entropy search.
result Robust performance with low computational overhead across various optimization challenges.
A new framework integrates classification and regression tasks in multi-task learning.
problem Jointly solving classification and regression tasks in multi-task scenarios.
method Two-Stage Learning-to-Defer (L2D) framework with a unified deferral mechanism.
result Unified deferral mechanism ensures convergence to the Bayes-optimal rejector.
A new method classifies multiple correlated data streams simultaneously.
problem Classifying multiple correlated data streams in practical scenarios.
method Double-Coupling Support Vector Machines (DC-SVM) considers both internal and external correlations.
result The proposed method outperforms traditional methods on artificial and real-world data streams.
Paper introduces a new model to handle multi-task learning across different input domains.
problem Learning correlated tasks across varying input domains.
method Develops a novel heterogeneous stochastic variational linear model of coregionalization (HSVLMC) for multi-task learning.
result The proposed model outperforms existing models in diverse multi-task scenarios.
Enhances load forecasting for multiple entities with dynamic similarities.
problem Inaccurate probabilistic load predictions due to uncertainties and dynamic changes.
method Online multi-task learning for probabilistic load forecasting.
result Significantly enhances load forecasting accuracy across various scenarios.
New bounds for multi-task learning with varying task sizes.
problem Generalization in multi-task learning with tasks of different sizes.
method PAC-Bayesian bounds for unbalanced settings.
result Stronger generalization bounds for multi-task learning with varying task sizes.
Enhances cooperative multi-task SemCom for distributed users.
problem Performance degradation in cooperative multi-tasking due to negative information transfer.
method Federated learning (FL) with semantic-aware task clustering.
result Constructive cooperation across distributed users with semantic-aware task clustering.
Mixture of multi-task GPs for clustering and prediction of functional data.
problem Handling multi-task learning, clustering, and prediction for functional data.
method A mixture of multi-task Gaussian processes with a variational EM algorithm for hyper-parameter optimization.
result Enhanced predictive performance for group-structured data.
This work extends HiP-MDPs to robust state abstractions for multi-task and meta-reinforcement learning.
problem Limited observability of state in HiP-MDPs for real-world scenarios with rich observation spaces.
method Inspired by Block MDPs, the work extends HiP-MDPs to enable robust state abstractions for multi-task and meta-reinforcement learning.
result Transfer and generalization bounds based on task and state similarity, and sample complexity bounds that depend on the aggregate number of samples across tasks.
MAGMA uses a common mean process to improve multi-step-ahead time series forecasting.
problem Improving multiple-step-ahead predictions for time series data.
method Proposes a novel multi-task Gaussian process framework with a common mean process for sharing information across tasks.
result Significantly improves predictive performances, even far from observations, and reduces computational complexity.
We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on the family of kernels used for learning, solving several related tasks simultaneou…
This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As shown by our empirical results, our algorithm consistently outperforms the traditio…
Paper introduces MTGP for engineering tasks with sparse data.
problem Challenges of data sparsity and varying task correlations in engineering.
method Multi-Task Gaussian Processes (MTGP) framework.
result Improves predictive performance and reduces computational costs.
We study the problem of estimating multiple linear regression equations for the purpose of both prediction and variable selection. Following recent work on multi-task learning Argyriou et al. [2008], we assume that the regression vectors share the same sparsity pattern. This means that the set of relevant predictor var…
Improves classifier performance in multi-stage processes with adversarial autoencoders and multi-task learning.
problem Challenges in training classifiers due to varying sample sizes and information content across stages.
method Combines adversarial autoencoders, multi-task learning, and semi-supervised learning to address underfitting and overfitting.
result Our approach outperforms state-of-the-art methods across different domains.
Algorithm improves transfer learning by inferring successor maps.
problem Machine learning challenges in multi-task scenarios.
method Combining factorized representations and nonparametric memory-based approaches.
result Improves transfer capabilities and outperforms other algorithms.
Boosted tree method improves MTL in heterogeneous domains.
problem Improving MTL in diverse, domain-specific tasks.
method Two-stage approach: common model for shared features, specific models for task-specific instances.
result Enhanced multi-task learning performance with interpretability.
Collaborative filtering often suffers from sparsity and cold start problems in real recommendation scenarios, therefore, researchers and engineers usually use side information to address the issues and improve the performance of recommender systems. In this paper, we consider knowledge graphs as the source of side info…
New estimator tackles multi-task linear regression with outliers, avoiding eigenvalue lower bounds.
problem Multi-task linear regression with contaminated tasks and eigenvalue lower bounds failure.
method Matrix-weighted norm regularization and relative balancedness condition.
result Prediction MSE bounds match Duan and Wang (2023) under weaker spectral assumptions.
It was recently shown that architectural, regularization and rehearsal strategies can be used to train deep models sequentially on a number of disjoint tasks without forgetting previously acquired knowledge. However, these strategies are still unsatisfactory if the tasks are not disjoint but constitute a single increme…
Paper proposes a novel MTL framework for personalized modeling of diverse individuals.
problem Personalized modeling of heterogeneous subpopulations with high-dimensional data.
method Low-rank tensor decomposition for multi-task learning.
result Superior performance compared to benchmarks in diverse subpopulation scenarios.
RMT-Net tackles biased credit scoring data by learning from both default/non-default and rejection/approval tasks.
problem Missing-not-at-random selection bias in financial credit scoring data.
method Reject-aware Multi-Task Network (RMT-Net) that leverages the correlation between default/non-default and rejection/approval tasks.
result RMT-Net improves credit scoring models by learning from both default/non-default and rejection/approval tasks.
Normative modeling has recently been proposed as an alternative for the case-control approach in modeling heterogeneity within clinical cohorts. Normative modeling is based on single-output Gaussian process regression that provides coherent estimates of uncertainty required by the method but does not consider spatial c…
TXtract extracts structured knowledge from thousands of product categories.
problem Extracting structured knowledge from diverse product categories in e-commerce.
method TXtract uses a taxonomy-aware model with category conditional self-attention and multi-task learning.
result TXtract outperforms state-of-the-art approaches by up to 10% in F1 and 15% in coverage across all categories.
In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data is available for all tasks, we consider a new setting, in which for some tasks, potentially most of them, only unlabeled training data is …
New method for learning evolving tasks with performance guarantees.
problem Learning tasks in a sequence with evolving similarity.
method Adaptable learning methodology with performance guarantees.
result Improved performance in multiple scenarios with reliable guarantees.
Extends GP models for sequential data, scalable and robust.
problem Handling sequential input-output observations in multi-task settings.
method Variational inference with sparse approximations and recursive GP priors.
result Tractable continual learning with KL divergences and recursive reconstruction.
Two-block ADMM outperformed multi-block ADMM in multi-task learning experiments.
problem Comparing two-block vs. multi-block ADMM in optimization performance.
method Compared two-block and multi-block ADMM on multi-task learning problems.
result Multi-block ADMM consistently outperformed two-block ADMM in optimization and prediction performance.
Automatically finds efficient multi-task models with less data.
problem Training separate models requires more data, parameters, and time.
method Compact search space for multi-task architectures, feature distillation for quick evaluation.
result Automatically identifies multi-task architectures that balance resource requirements and performance.
Small parameterized towers improve multi-task learning efficiency and generalization.
problem Balancing Pareto efficiency and generalization in multi-task learning.
method Under-parameterized self-auxiliaries for multi-task models.
result Small parameterized towers enhance Pareto efficiency in various multi-task applications.
Multi-task learning uses auxiliary data or knowledge from relevant tasks to facilitate the learning in a new task. Multi-task optimization applies multi-task learning to optimization to study how to effectively and efficiently tackle multiple optimization problems simultaneously. Evolutionary multi-tasking, or multi-fa…
Gradient surgery improves multi-task learning efficiency.
problem Challenges in sharing structure across multiple tasks.
method Gradient projection onto normal plane of conflicting gradients.
result Substantial gains in efficiency and performance.
We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient updates should be statistically indistinguishable from each other. We enforce this c…
We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like multi-task learning and structured out- put prediction. We show that multi-task ke…
Reliable and effective multi-task learning is a prerequisite for the development of robotic agents that can quickly learn to accomplish related, everyday tasks. However, in the reinforcement learning domain, multi-task learning has not exhibited the same level of success as in other domains, such as computer vision. In…
Disentangled representations naturally emerge in multi-task learning.
problem Finding adaptable representations for multiple tasks.
method Empirical study of neural networks trained on automatically generated supervised tasks.
result Disentanglement naturally occurs during multi-task learning.
HMS-BERT detects cyberbullying in multiple languages and labels.
problem Multilingual and multi-label cyberbullying detection challenges.
method Hybrid multi-task self-training framework using BERT.
result Strong performance on multi-label and main classification tasks.
New method learns multiple reward functions for complex tasks.
problem Learning reward functions for tasks with multiple ways of solving.
method Combines maximum entropy approach with Dirichlet process clustering.
result Method accurately learns reward functions for complex tasks.
SurvTRACE uses transformers to analyze survival times with competing events.
problem Analyzing survival times with multiple competing events and confounders.
method Transformer-based model for survival analysis, handling competing events and confounders.
result SurvTRACE outperforms existing methods in multi-event scenarios.
Near-optimal rates for multi-task learning with shared representations.
problem Approximation and statistical complexity of learning multiple operators.
method Multiple Neural Operators (MNO) architecture and comparison with DeepONet.
result Near-optimal upper and lower bounds for approximation and generalization.
SON-GOKU uses graph coloring to improve multi-task learning by partitioning tasks into compatible groups.
problem Gradient interference between conflicting multi-task learning objectives slows convergence and model performance.
method SON-GOKU computes gradient interference, constructs an interference graph, and applies greedy graph-coloring to partition tasks.
result SON-GOKU consistently outperforms baselines and state-of-the-art multi-task optimizers on six datasets.
New approach for multi-task reinforcement learning without task interference.
problem Efficient knowledge sharing between tasks in reinforcement learning.
method Attention-based multi-task deep reinforcement learning.
result Achieves positive knowledge transfer and avoids negative transfer.
Wide neural networks can benefit from multi-task learning in their infinite-width limit.
problem The generalization behavior of wide neural networks in multi-task learning settings.
method Optimizing wide ReLU neural networks with L2-regularization promotes multi-task learning in the infinite-width limit.
result An exact quantitative characterization of multi-task learning in the infinite-width limit of wide ReLU neural networks.
Deep multi-task learning benefits from low intrinsic dimensionality, leading to better generalization.
problem Improving generalization in deep multi-task learning with high-dimensional models.
method Parametrizing multi-task networks in a low-dimensional space using random expansions and weight compression.
result First non-vacuous generalization bounds for deep multi-task networks are derived.
In a variety of application domains the content to be recommended to users is associated with text. This includes research papers, movies with associated plot summaries, news articles, blog posts, etc. Recommendation approaches based on latent factor models can be extended naturally to leverage text by employing an exp…