Automatically finds efficient multi-task models with less data.
problem Training separate models requires more data, parameters, and time.
method Compact search space for multi-task architectures, feature distillation for quick evaluation.
result Automatically identifies multi-task architectures that balance resource requirements and performance.
The paper uses random matrix theory for multi-task regression, improving time series forecasting.
problem Improving time series forecasting using multi-task regression.
method Applying random matrix theory to multi-task regression problems, deriving closed-form solutions for optimization.
result Provides a robust foundation for hyperparameter optimization in multi-task regression scenarios.
Small parameterized towers improve multi-task learning efficiency and generalization.
problem Balancing Pareto efficiency and generalization in multi-task learning.
method Under-parameterized self-auxiliaries for multi-task models.
result Small parameterized towers enhance Pareto efficiency in various multi-task applications.
Develops a scalable multi-task Gaussian process with neural embedding for improved performance.
problem High model complexity and limited model capability in multi-task Gaussian processes.
method Neural embedding of coregionalization, advanced variational inference, sparse approximation.
result Higher prediction quality and better generalization of the NSVLMC model.
SON-GOKU uses graph coloring to improve multi-task learning by partitioning tasks into compatible groups.
problem Gradient interference between conflicting multi-task learning objectives slows convergence and model performance.
method SON-GOKU computes gradient interference, constructs an interference graph, and applies greedy graph-coloring to partition tasks.
result SON-GOKU consistently outperforms baselines and state-of-the-art multi-task optimizers on six datasets.
VIRTUAL improves federated multi-task learning for non-convex models.
problem Real-world federated datasets show statistical heterogeneity.
method VIRTUAL treats federated network as a star-shaped Bayesian network and uses variational inference.
result VIRTUAL outperforms state-of-the-art for federated learning on real-world datasets.
Paper estimates noise covariance in correlated multi-task linear models.
problem Estimating noise covariance in multi-task high-dimensional linear models with correlated noise.
method Uses multi-task elastic-net and lasso estimators to estimate noise covariance, correcting bias in squared residual matrix.
result Develops a novel estimator of noise covariance that converges at rate n−1/2, matching oracle estimator under suitable conditions. Gradient surgery improves multi-task learning efficiency.
problem Challenges in sharing structure across multiple tasks.
method Gradient projection onto normal plane of conflicting gradients.
result Substantial gains in efficiency and performance.
Paper introduces a new model to handle multi-task learning across different input domains.
problem Learning correlated tasks across varying input domains.
method Develops a novel heterogeneous stochastic variational linear model of coregionalization (HSVLMC) for multi-task learning.
result The proposed model outperforms existing models in diverse multi-task scenarios.
Bayesian approach improves network lasso for multi-task learning.
problem Improving the determination of relational coefficients in network lasso.
method Proposes a Bayesian approach to solve multi-task learning problems using network lasso.
result Objective determination of relational coefficients through Bayesian estimation.
This paper investigates multi-task reinforcement learning in non-Markovian decision making, showing benefits in sample efficiency.
problem Investigating multi-task reinforcement learning in non-Markovian decision making processes.
method Developed a joint model class for tasks and used the η-bracketing number to quantify complexity and similarity. result Multi-task reinforcement learning can improve sample efficiency in non-Markovian decision making processes.
SPMTC improves multi-task clustering by self-paced training and soft version.
problem Local optima and outliers in traditional MTC models.
method Self-paced multi-task clustering (SPMTC) with alternating optimization.
result SPMTC reduces local optima risk and improves clustering performance.
This paper reviews dMTL and methods for selecting auxiliary tasks.
problem Improving model performance for multiple tasks.
method Review of dMTL approaches and methods for selecting auxiliary tasks.
result Methods for selecting auxiliary tasks can improve dMTL performance.
SUM combines meta-learning with gradient descent to improve spatiotemporal data prediction.
problem Weak performance of traditional multi-task learning methods with few tasks.
method Two-step suboptimal unitary method (SUM) integrating meta-learning and gradient descent.
result SUM outperforms traditional methods on distant tasks and integrates with coKriging.
A model learns set comparison, vague quantification, and proportional estimation from visual scenes.
problem Learning of quantification mechanisms from visual scenes.
method A multi-task computational model that integrates set comparison, vague quantification, and proportional estimation.
result The multi-task model performs better when lower-complexity tasks are available and can generalize to unseen combinations.
Exploration in multi-task reinforcement learning is critical in training agents to deduce the underlying MDP. Many of the existing exploration frameworks such as E3, Rmax, Thompson sampling assume a single stationary MDP and are not suitable for system identification in the multi-task setting. We present a nove…
This paper proposes a method to reveal task relationships in multi-task learning models using sparse graphs.
problem Understanding the underlying task relationships in multi-task learning models.
method Proposes a bilevel formulation of multi-task learning that induces sparse graphs.
result The method improves interpretability of multi-task learning models without sacrificing generalization performance.
Study improves GMM learning performance through multi-task and transfer learning.
problem Improving GMM learning performance through similar task structures.
method Proposes a multi-task GMM learning procedure based on EM algorithm, robust to outliers.
result Achieves minimax optimal rate of convergence for parameter estimation and mis-clustering.
Flexible multi-task learning framework using summary statistics.
problem Data-sharing constraints in healthcare settings.
method Proposes a flexible multi-task learning framework utilizing summary statistics and adaptive parameter selection.
result Systematic non-asymptotic analysis and simulations demonstrate the method's performance.
This paper evaluates heterogeneous information fusion using multi-task Gaussian processes in the context of geological resource modeling. Specifically, it empirically demonstrates that information integration across heterogeneous information sources leads to superior estimates of all the quantities being modeled, compa…
TempLe learns transition templates for efficient multi-task RL.
problem Efficiently transferring knowledge across different RL tasks with varying state/action spaces.
method Generates transition dynamics templates to abstract similarities between tasks.
result Achieves significantly lower sample complexity than single-task or multi-task methods.
Paper extends multi-task Gaussian Cox processes for heterogeneous tasks.
problem Modeling multiple heterogeneous correlated tasks jointly.
method Data augmentation and mean-field approximation for non-conjugate Bayesian inference.
result Demonstrates improved performance and inference on synthetic and real data.
Multi-task learning is a learning paradigm which seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this paper, we propose a regularization formulation for learning the relationships between tasks in multi-task learning. This formulation can be viewed as a n…
A method to reuse 98% of parameters for multi-task learning.
problem Improving efficiency in deep learning parameter usage.
method Learning model patches for each task, reusing pretrained network parameters.
result Significant improvement in transfer learning accuracy with fewer parameters.
Deep multi-task learning benefits from low intrinsic dimensionality, leading to better generalization.
problem Improving generalization in deep multi-task learning with high-dimensional models.
method Parametrizing multi-task networks in a low-dimensional space using random expansions and weight compression.
result First non-vacuous generalization bounds for deep multi-task networks are derived.
Survey on multi-task learning for deep neural networks.
problem Simultaneous learning of multiple tasks by a shared model.
method Partitioning deep MTL techniques into architectures, optimization methods, and task relationship learning.
result Improved data efficiency and reduced overfitting through shared representations.
Multi-task learning improves robotic control in continuous action spaces.
problem Robotic control in continuous action spaces lacks effective multi-task learning methods.
method Applied multi-task learning methods to continuous action spaces and compared performance with baselines.
result Multi-task learning outperforms baselines and alternative methods in continuous control tasks.
A new framework integrates classification and regression tasks in multi-task learning.
problem Jointly solving classification and regression tasks in multi-task scenarios.
method Two-Stage Learning-to-Defer (L2D) framework with a unified deferral mechanism.
result Unified deferral mechanism ensures convergence to the Bayes-optimal rejector.
Unified analysis of multi-task functional linear regression with manifold and composite penalties.
problem Estimating slope functions from functional data with multi-task learning.
method Penalized splines with manifold constraint and composite quadratic penalty.
result Unified convergence upper bound and phase transition behaviors for estimators.
New method uses shared attention for multi-task time series forecasting.
problem Insufficient training instances in single-task forecasting.
method Self-attention based sharing schemes across multiple tasks.
result Outperforms state-of-the-art single-task forecasting baselines and RNN-based multi-task forecasting method.
MTGA optimizes multiple tasks with auxiliary data.
problem Optimizing multiple tasks simultaneously.
method Evolutionary multi-tasking genetic algorithm (MTGA).
result MTGA outperforms other approaches in optimization.
A multi-task learning framework improves BioNER performance across different entity types.
problem Limited performance of BioNER systems due to lack of training data for each entity type.
method Multi-task learning framework that collectively uses training data of different entity types.
result Substantially better performance on 15 benchmark BioNER datasets compared to state-of-the-art systems.
Paper tackles multi-task learning for molecular property prediction with limited data.
problem Limited labeled data for each molecular property task in drug discovery.
method Proposes SGNN-EBM method to utilize relation graph between tasks and improve multi-task learning performance.
result Empirical results show the effectiveness of SGNN-EBM.
Paper improves conversion prediction models for online advertising.
problem Predicting different types of conversions in online advertising.
method Multi-Task Learning with MT-FwFM.
result Improved AUC by 0.74% and 0.84% on two conversion types, and overall AUC by 0.50%.
Boosts share routing for multi-task learning with flexible sparse connections.
problem Designing suitable sharing mechanisms among multiple tasks in multi-task learning.
method Proposes MTNAS framework to modularize sharing into sub-networks with sparse connections and gating.
result Demonstrates consistent improvement over single-task and typical multi-task methods while maintaining efficiency.
BoRA finetunes multi-task LLMs by sharing information through hierarchical priors.
problem Limited data for some tasks in multi-task LLMs.
method Bayesian hierarchical low-rank adaption.
result BoRA outperforms individual and unified model approaches.
Study of multi-task semi-supervised learning in high dimensions.
problem Analysis of multi-task semi-supervised learning in high-dimensional settings.
method Random matrix theory applied to characterize asymptotics of key functionals.
result Predicts algorithm performance and provides efficient usage guidelines.
Enhanced DPP model improves basket completion tasks.
problem Improving recommendation quality for basket completion.
method Specialized multi-task DPP model for multi-class classification.
result Multi-task DPP provides significantly better predictive quality.
This paper treats multi-task learning as a multi-objective optimization problem.
problem Conflict between tasks in multi-task learning.
method Explicitly cast multi-task learning as multi-objective optimization and use gradient-based multi-objective optimization algorithms.
result Optimizing an upper bound of the multi-objective loss yields a Pareto optimal solution.
Develops multi-task learning models for ordinal regression with heterogeneous data.
problem Tackling ordinal regression for heterogeneous, non-IID data.
method Sparse and deep multi-task learning approaches.
result Proposed MTOR models improve prediction performance.
Algorithm for agents to agree on a single objective in multi-task networks.
problem Decentralized decision-making in multi-task networks with multiple objectives.
method Distributed decision-making algorithm for agents observing different models.
result Agents reach agreement on which model to track for network performance enhancement.
New algorithm learns kernels for multi-task learning.
problem Improving performance in multi-task learning scenarios.
method Support Vector Machine-regularized model with neighborhood kernels.
result Consistently outperforms traditional kernel learning methods.
Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks to a single machine. However, in many real-world applications, data of differen…
Multi-task learning has shown to significantly enhance the performance of multiple related learning tasks in a variety of situations. We present the fused logistic regression, a sparse multi-task learning approach for binary classification. Specifically, we introduce sparsity inducing penalties over parameter differenc…
We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like multi-task learning and structured out- put prediction. We show that multi-task ke…
Framework for multi-task learning with semiparametric models and nuisance parameters.
problem Improving parameter estimation from diverse, heterogeneous datasets.
method Late fusion multi-task learning framework with two-step process: individual task learning followed by adaptive aggregation.
result The method achieves faster convergence rates compared to individual task learning when tasks share similar parametric components.
Proposes a low-rank deep CNN for multi-task learning.
problem Multi-task learning with deep neural networks.
method Low-rank deep network with nuclear norm and sparsity penalties.
result Improves performance on multiple tasks compared to standard models.
Proposes Ada-Sit method for mortality prediction of rare diseases.
problem Data insufficiency and clinical diversity of rare diseases make mortality prediction hard.
method Initialization-sharing multi-task learning method (Ada-Sit) for fast adaptation to similar tasks.
result Experimental results show the proposed model is effective for mortality prediction of diverse rare diseases.