Study finds methods to learn multiple solutions from single task in offline RL.
problem Learning multiple solutions from a single task in offline RL.
method Proposed algorithms for offline RL.
result Empirical results show learning of multiple solutions in offline RL.
Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to each other, hence it could be advantageous to transfer information only between …
Paper proposes a new framework for multitask learning using multiple kernels.
problem Efficiently learn kernel weights for multiple related tasks.
method Formulates a regularization-based approach called MK-MTRL to model task relationships in latent feature spaces.
result Proposed framework outperforms state-of-the-art multitask learning methods.
New method learns multiple reward functions for complex tasks.
problem Learning reward functions for tasks with multiple ways of solving.
method Combines maximum entropy approach with Dirichlet process clustering.
result Method accurately learns reward functions for complex tasks.
Proposes a cross-scale residual network for multiple image restoration tasks.
problem Image restoration tasks (super-resolution, denoising, deblocking) have strong correlations.
method Cross-scale residual network exploiting scale-related features and inter-task correlations.
result Outperforms state-of-the-art methods in multiple image restoration tasks.
MTNPs jointly model multiple correlated tasks from various sources.
problem Naive NPs can only model a single stochastic process and infer tasks independently.
method MTNPs are a hierarchical extension of NPs that jointly infer tasks from multiple stochastic processes, considering inter-task correlation and handling incomplete data.
result MTNPs successfully model multiple tasks jointly, discovering and exploiting their correlations in various real-world data.
Learning policies that generalize across multiple tasks is an important and challenging research topic in reinforcement learning and robotics. Training individual policies for every single potential task is often impractical, especially for continuous task variations, requiring more principled approaches to share and t…
MPP trains a transformer to predict multiple physical systems, improving accuracy across various tasks.
problem Training models for specific physical systems is inefficient and requires fine-tuning.
method MPP trains a shared transformer on multiple heterogeneous physical systems, projecting fields into a shared embedding space.
result A single MPP-pretrained transformer outperforms task-specific models on all pretraining sub-tasks and downstream tasks.
Reduces constructing multiplicative connections to simpler tasks.
problem Constructing multiplicative connections on proper Lie groupoids.
method Reduction to simpler tasks involving proper and regular Lie groupoids.
result Simpler methods for constructing multiplicative connections.
Modeling student behaviors and multiple predictions for early intervention.
problem Predicting student outcomes and interactions among multiple tasks.
method Proposes a variant of LSTM and soft-attention mechanism for heterogeneous behaviors, and co-attention mechanism for task interactions.
result Demonstrated effectiveness in predicting student outcomes and interactions.
Unified model for multiple healthcare tasks using graph structure.
problem Multiple healthcare tasks with shared graph structure.
method Graph-Convolutional Network (GCN) with multiple variational autoencoders.
result Boosted performance across all tasks, outperforming state-of-the-art.
MCP learns reusable skills for complex tasks by combining simple ones.
problem Learning complex tasks with many skills requires impractical amounts of data.
method Factorizes skills into primitives that can be combined multiplicatively.
result MCP can learn and reuse skills for novel tasks from pre-training.
BI-MAML learns multiple tasks without forgetting old ones.
problem Catastrophic forgetting in meta learning.
method Incremental model adaptation with balanced learning strategy.
result BI-MAML outperforms state-of-the-art models in accuracy and efficiency.
We generalise the problem of inverse reinforcement learning to multiple tasks, from multiple demonstrations. Each one may represent one expert trying to solve a different task, or as different experts trying to solve the same task. Our main contribution is to formalise the problem as statistical preference elicitation,…
This work tackles autonomous learning of interrelated tasks in robots.
problem Learning interrelated tasks in robots, especially in complex environments.
method Using a multi-task reinforcement learning approach within an MDP framework.
result Demonstrates how to autonomously learn interrelated tasks in robots.
Speech data from multiple tasks improves AD detection models.
problem Limited AD detection models trained on single-task speech datasets.
method Augmented AD-specific dataset with multi-task healthy data.
result AD detection improved by up to 9% with heterogeneous data.
Enhances load forecasting for multiple entities with dynamic similarities.
problem Inaccurate probabilistic load predictions due to uncertainties and dynamic changes.
method Online multi-task learning for probabilistic load forecasting.
result Significantly enhances load forecasting accuracy across various scenarios.
Model learns from multiple data sources for D2T and T2D tasks.
problem Limited performance due to single-source corpora.
method Variational auto-encoder with disentangled style and content variables.
result Model outperforms single-source counterpart on multiple datasets.
Near-optimal rates for multi-task learning with shared representations.
problem Approximation and statistical complexity of learning multiple operators.
method Multiple Neural Operators (MNO) architecture and comparison with DeepONet.
result Near-optimal upper and lower bounds for approximation and generalization.
The paper introduces InfoRL, a method to learn multiple ways to perform tasks in complex environments.
problem Learning a single best policy for tasks in complex environments.
method InfoMax approach to discover multiple latent codes for task performance.
result It is possible to learn multiple ways to perform tasks in complex environments using information maximization.
Deep User Perception Network learns universal user representations from multiple e-commerce tasks.
problem Lack of shared user information across diverse e-commerce tasks.
method Model user behavior sequences using LSTM and attention mechanism, sharing user representations across multiple tasks.
result Our approach consistently achieves better results in personalization across multiple e-commerce tasks.
New method for learning evolving tasks with performance guarantees.
problem Learning tasks in a sequence with evolving similarity.
method Adaptable learning methodology with performance guarantees.
result Improved performance in multiple scenarios with reliable guarantees.
This research improves multitask learning by creating task-specific pathways.
problem Creating task-specific representations for efficient learning.
method Developed generalization bounds for learning multiple tasks over multiple pathways.
result Proves the superiority of multipath representation over traditional shallow supernets.
Proposes NCMN to remove feature correlation in multiplicative noise.
problem High feature correlation in multiplicative noise reduces network performance.
method Exploits batch normalization to remove correlation effect.
result Significantly improves performance on image classification tasks.
JAMPI improves matrix multiplication in Spark, boosting performance by up to 24%.
problem Efficiently performing matrix multiplication in Spark.
method Combining asynchronous network IO, auto-vectorization, and barrier execution mode.
result Up to 24% performance increase in distributed matrix multiplication.
Single neural network learns multiple tasks from combined data.
problem Can a single neural network learn multiple unrelated tasks?
method Investigates how task representations affect joint learning; uses various task encoding methods.
result Single neural network can learn multiple tasks from combined data, even when tasks are unrelated and different.
Adaptive methods learn from multiple datasets, leveraging similarities and robust to outliers.
problem Simultaneously analyze multiple datasets with possible similarities and differences.
method Adaptive multi-task learning methods that automatically utilize similarities and handle differences.
result Sharp statistical guarantees and robustness against outlier tasks demonstrated.
Extends OC-KSR for multi-task one-class classification.
problem Improving one-class classification performance with shared information.
method Linear and non-linear structure learning mechanisms for multi-task one-class classification.
result Improved performance on multiple one-class problems.
Paper presents a probabilistic framework for diffusion synchronization.
problem Improper application of heuristics leads to suboptimal results in diffusion synchronization.
method Develops a probabilistic framework to analyze and adapt correlation models for each specific task.
result Achieves better results by identifying optimal correlation models per task.
A new method classifies multiple correlated data streams simultaneously.
problem Classifying multiple correlated data streams in practical scenarios.
method Double-Coupling Support Vector Machines (DC-SVM) considers both internal and external correlations.
result The proposed method outperforms traditional methods on artificial and real-world data streams.
A method learns common bias for multiple low-variance tasks without hyper-parameter tuning.
problem Learning common bias for multiple low-variance tasks without manual tuning.
method Two variants of online learning methods (aggressive and lazy) that update bias after each datapoint or at the end of each task.
result Across-tasks regret bound derived for the method, showing faster rates for aggressive variant and standard rates for lazy variant.
Single model performs well across diverse tasks.
problem Improving deep learning across multiple domains.
method Concurrent training on diverse tasks, incorporating multiple domain-specific components.
result Single model yields good results on various domains.
MT-HAL learns features and task associations for multiple tasks with a shared sparse structure.
problem Learning features and task associations for multiple tasks with shared structure.
method Fully nonparametric approach that learns features, samples, and task associations with a shared sparse structure.
result MT-HAL achieves a powerful convergence rate and outperforms other methods across various simulation settings.
DiGrad improves multi-task reinforcement learning in robotic systems.
problem Efficient multi-task reinforcement learning in complex robotic systems with shared actions.
method Differential Policy Gradient (DiGrad) for simultaneous training of multiple tasks in a single actor-critic network.
result DiGrad outperforms related methods in continuous action spaces, supporting efficient multi-task learning.
Improved method learns robust speech representations from multiple tasks.
problem Learning good speech representations without supervision.
method Single encoder with multiple self-supervised tasks.
result Transferable, robust, problem-agnostic features learned.
Efficiently models multiple correlated point data using generalized LGCPs.
problem Joint modeling of multiple correlated point data.
method Generalized LGCP framework with Gaussian process priors and variational inference.
result Orders of magnitude faster inference compared to existing methods.
Network anomaly detection is still a vibrant research area. As the fast growth of network bandwidth and the tremendous traffic on the network, there arises an extremely challengeable question: How to efficiently and accurately detect the anomaly on multiple traffic? In multi-task learning, the traffic consisting of flo…
Integrates multiple datasets to solve open set crowdsourcing problems.
problem Crowdsourcing with unknown label space and unfamiliar tasks.
method Integrates multiple crowdsourced datasets, weights them based on category correlation, and uses open set transfer learning.
result Proves OSCrowd solves open set crowdsourcing problems and outperforms related solutions.
Optimal task order improves continual learning performance.
problem Challenges in neural networks learning multiple tasks in sequence.
method Linear teacher-student model with latent factors, derived analytical expression.
result Two principles for optimal task order: least representative first and dissimilar adjacent tasks.
Jointly forecast multiple related stocks using multi-task learning.
problem Forecasting multiple related stocks considering shared and private information.
method Multi-task learning framework with attention method.
result Improved forecasting performance on various data.
Introduces MLM dataset for multitask learning across multiple languages and modalities.
problem Training and evaluating multitask systems on diverse data.
method Develops a new benchmark dataset with semantic data and modalities.
result Demonstrates challenges in generalizing on diverse data.
Develops a new method to improve performance in multi-objective learning problems.
problem Gradient bias in multi-objective learning leading to degraded performance.
method Stochastic Multi-objective gradient Correction (MoCo) method that guarantees convergence without increasing batch size.
result Demonstrates effectiveness of MoCo method in simulations on multi-task learning.
Improves shared encoder representations for better multi-task learning performance.
problem Improving quality of shared encoder representations in multi-task learning.
method Dummy Gradient norm Regularization (DGR) to decrease gradient norm of dummy task-specific predictors.
result DGR improves multi-task prediction performances and superior performance compared to existing methods.
Task-agnostic RL tackles exploration in MDPs with multiple tasks.
problem Challenges in reinforcement learning with multiple tasks or conflicting objectives.
method Task-agnostic RL framework, UCBZero algorithm.
result UCBZero finds near-optimal policies for multiple tasks efficiently.
RNNs solve modular addition tasks using low rank and sparse Fourier structures.
problem Solving modular addition tasks with recurrent neural networks.
method Identified low rank structures and sparse Fourier representations in RNN weights.
result RNNs robust to removing individual frequencies but degrade with more ablation.
New method uses fewer parameters to match state-of-the-art performance on multiple natural language tasks.
problem Efficiently adapting BERT for multiple tasks with fewer parameters.
method PALs (projected attention layers) for shared BERT model with task-specific parameters.
result Matches state-of-the-art performance on GLUE benchmark with 7 times fewer parameters.
SureMap estimates model performance across subpopulations efficiently.
problem Estimating model performance across subpopulations with scarce data.
method Simultaneous Gaussian mean estimation with external data.
result High accuracy in both multi-task and single-task disaggregated evaluations.
Dynamic weights improve multimodal emotion and gender recognition.
problem Improving performance in multiple classification tasks with a single model.
method Dynamic joint loss weights for multimodal emotion and gender recognition.
result Lower joint loss and better generalizability than static weights.