Gradient surgery improves multi-task learning efficiency.
problem Challenges in sharing structure across multiple tasks.
method Gradient projection onto normal plane of conflicting gradients.
result Substantial gains in efficiency and performance.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Task Efficiency”
CoLoRA leverages task similarity to boost fine-tuning efficiency.
problem Efficiently fine-tuning large foundation models with scarce labeled data.
method CoLoRA trains a shared adapter for task similarity and personalized adapters for user-specific tasks.
result CoLoRA significantly boosts fine-tuning performance when tasks are similar.
This work improves sample efficiency in meta-learning for nonlinear tasks.
problem Learning complex tasks efficiently with limited data.
method Subspace-based representations for nonlinear tasks.
result Subspace-based representations can be learned efficiently and improve future task performance.
Unified scoring model improves efficiency and performance across multiple tasks.
problem Efficient and resource-efficient automated scoring for diverse tasks.
method Knowledge-distilled multi-task Mixture-of-Experts (MoE) approach.
result Comparable performance to task-specific models with significantly less storage and training resources.
Novel meta-RL strategy improves efficiency in learning novel tasks.
problem Efficiency in learning novel tasks using deep RL.
method Decomposes meta-RL into task-exploration, task-inference, and task-fulfillment; uses deep networks and a task encoder.
result Improves sample efficiency and mitigates meta-overfitting.
Small parameterized towers improve multi-task learning efficiency and generalization.
problem Balancing Pareto efficiency and generalization in multi-task learning.
method Under-parameterized self-auxiliaries for multi-task models.
result Small parameterized towers enhance Pareto efficiency in various multi-task applications.
TempLe learns transition templates for efficient multi-task RL.
problem Efficiently transferring knowledge across different RL tasks with varying state/action spaces.
method Generates transition dynamics templates to abstract similarities between tasks.
result Achieves significantly lower sample complexity than single-task or multi-task methods.
Probabilistic active meta-learning improves data efficiency in robotics.
problem Data-efficient learning in robotics where data collection is expensive.
method Conceptualizing meta-learning with a probabilistic latent variable model for sequential task selection.
result Improves data efficiency compared to baselines on simulated robotic experiments.
Cost forecasting helps crowdsourcers manage growing task sets efficiently.
problem Crowdsourcers face resource overwhelm with growing task sets.
method Cost forecasting to decide between new tasks or existing ones based on cost efficiency.
result Cost forecasting improves accuracy and efficiency in crowdsourcing.
Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience, several major challenges preclude their practicality. Current methods rely heavi…
This paper investigates multi-task reinforcement learning in non-Markovian decision making, showing benefits in sample efficiency.
problem Investigating multi-task reinforcement learning in non-Markovian decision making processes.
method Developed a joint model class for tasks and used the -bracketing number to quantify complexity and similarity.
result Multi-task reinforcement learning can improve sample efficiency in non-Markovian decision making processes.
MUMBO optimizes multiple tasks efficiently, even with low-cost related functions.
problem Efficiently optimizing multiple related functions with low-cost evaluations.
method Derives a novel multi-task version of entropy search.
result Robust performance with low computational overhead across various optimization challenges.
Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the generalization performance and the scalability for such problems. Scaling up MTL met…
Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Tasksstat.ML
This paper shows how diverse tasks can make inefficient exploration in MTRL efficient.
problem The challenge of efficient exploration in Multitask Reinforcement Learning.
method A generic policy-sharing algorithm with myopic exploration design trained on diverse tasks.
result A generic policy-sharing algorithm with myopic exploration design can be sample-efficient in MTRL.
Soft modularization improves sample efficiency and performance in reinforcement learning.
problem Challenges in training multiple tasks jointly in reinforcement learning.
method Explicit modularization technique on policy representation, soft modularization method.
result Improves sample efficiency and performance over strong baselines in robotics manipulation tasks.
Rewriting history improves RL algorithms for solving multiple tasks.
problem Improving sample efficiency in multi-task reinforcement learning.
method Introducing hindsight relabeling as inverse RL to generalize goal-relabeling techniques.
result Relabeling data using inverse RL accelerates learning in multi-task settings.
Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power. Thus efficient network design is a critical aspect especially for applications like automated driving which requires real-time performance. Recently, there has been a lot of resea…
SAFE automates feature engineering for industrial tasks efficiently and scalably.
problem Efficiency and scalability of automatic feature engineering methods for industrial tasks.
method SAFE (Scalable Automatic Feature Engineering) method, which provides excellent efficiency and scalability.
result SAFE method provides prominent efficiency and competitive effectiveness in industrial tasks.
CAM-GAN improves GANs for continual learning with efficient feature map transformations.
problem Efficient continual learning for GANs with reduced parameter growth.
method Designing and leveraging parameter-efficient feature map transformations, including global and task-specific parameters, residual bias, and Fisher information matrix.
result Significantly improved model performance and high-quality samples with fewer parameters.
Generalized Hindsight improves RL by reusing data from one task for another.
problem High sample complexity in reinforcement learning due to wasted uninformative data.
method Approximate inverse reinforcement learning to relabel behaviors with better-suited tasks.
result Efficient reuse of samples, reducing sample complexity on multi-task RL tasks.
The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward functions for environments with the same (or similar) dynamical models. We propose to l…
KM method reduces ConvNet parameters to 9% higher accuracy with minimal additional memory.
problem Expensive memory usage for training ConvNets on embedded devices.
method Kernel Modulation (KM) method that adapts all network parameters for each task.
result KM delivers up to 9% higher accuracy than other parameter-efficient methods.
HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulatorscs.LG
HRL4IN tackles interactive navigation tasks with mobile manipulators, improving efficiency and performance.
problem Interactive Navigation tasks require mobile manipulators to perform various actions, but choosing the right part of the embodiment is inefficient.
method HRL4IN uses a hierarchical reinforcement learning architecture to handle heterogeneous phases of navigation and manipulation, selecting the appropriate part of the embodiment for each phase.
result HRL4IN significantly outperforms flat PPO and HAC in terms of task performance and energy efficiency.
Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network parameters, where efficiency may be improved through transfer across related tas…
The paradigm of multi-task learning is that one can achieve better generalization by learning tasks jointly and thus exploiting the similarity between the tasks rather than learning them independently of each other. While previously the relationship between tasks had to be user-defined in the form of an output kernel, …
Plan2Explore learns new tasks efficiently through self-supervised planning.
problem Challenges in reinforcement learning, especially task-specific learning and sample efficiency.
method Self-supervised exploration and fast adaptation to new tasks through efficient planning.
result Plan2Explore outperforms prior methods in learning new tasks without supervision.
Survey on efficient robust estimators for high-dimensional statistics.
problem Efficient robust mean estimation in high dimensions.
method Emerging algorithmic techniques in theoretical computer science.
result First efficient robust estimators for fundamental tasks.
Algorithm improves sample efficiency for dynamic task adaptation.
problem Sample inefficiency in imitation learning for changing task distributions.
method Assigns importance weights to past demonstrations for meta adaptation.
result Robot adapts to unseen environments with few demonstrations.
Proposes efficient model for continual learning that grows model over task-specific parameters.
problem Limited transfer learning ability and forgetting of earlier knowledge in existing methods.
method Filter and channel expansion method that grows model over previous task parameters.
result Better knowledge transfer and improved performance in task incremental learning.
New algorithm improves learning efficiency in multi-task contextual bandits.
problem Improving learning efficiency in multi-task contextual bandits.
method Alternating projected gradient descent (GD) and minimization estimator for low-rank feature matrix recovery.
result Proved regret bound for multi-task learning algorithm.
DMTG groups tasks for multi-task learning in one shot.
problem Efficiently grouping and training multiple tasks in machine learning.
method Formulates Multi-Task Grouping as a differentiable pruning problem, training all groups simultaneously.
result Significantly improves training efficiency and mitigates objective bias.
Efficient streaming algorithms for robust statistics with near-optimal memory.
problem High-dimensional robust statistics tasks in streaming model.
method First efficient streaming algorithms with near-optimal memory requirements.
result Near-optimal error guarantees and space complexity nearly-linear in the dimension for robust mean estimation.
Allocation strategies improve the efficiency of crowdsourcing by decreasing the work needed to complete individual tasks accurately. However, these algorithms introduce bias by preferentially allocating workers onto easy tasks, leading to sets of completed tasks that are no longer representative of all tasks. This bias…
BI-MAML learns multiple tasks without forgetting old ones.
problem Catastrophic forgetting in meta learning.
method Incremental model adaptation with balanced learning strategy.
result BI-MAML outperforms state-of-the-art models in accuracy and efficiency.
CPVs enable efficient learning and generalization of complex tasks.
problem Learning and generalizing complex tasks efficiently.
method Compositional plan vectors (CPVs) for efficient task composition and generalization.
result CPVs enable efficient learning and generalization of complex tasks without additional supervision.
Paper analyzes dataset distillation for efficient encoding of task-relevant information.
problem Efficiently encoding task-relevant information from gradient-based learning of non-linear tasks.
method Theoretical analysis of dataset distillation applied to two-layer neural networks with gradient-based training.
result Low-dimensional structure of the problem is efficiently encoded into distilled data, reproducing a model with high generalization ability.
Integrates skills and world models for efficient task solving and transfer.
problem Quickly solve new tasks in complex environments using reusable knowledge.
method Leverages partial amortization for fast adaptation and online skill planning.
result Improved sample efficiency in single tasks and transfer between tasks.
THERMOMETER calibrates LLMs efficiently for diverse tasks.
problem Calibrating large language models is challenging due to computational and versatility issues.
method THERMOMETER learns an auxiliary model for calibrating a LLM using data from multiple tasks.
result THERMOMETER produces better-calibrated responses for new tasks.
Multi-task learning holds the promise of less data, parameters, and time than training of separate models. We propose a method to automatically search over multi-task architectures while taking resource constraints into consideration. We propose a search space that compactly represents different parameter sharing strat…
Differentially private policy evaluation improves reinforcement learning efficiency.
problem Sample inefficiency in reinforcement learning.
method Differentially private actor-critic model initialization.
result Improves sample efficiency in control problems.
Neural architecture search has been shown to hold great promise towards the automation of deep learning. However in spite of its potential, neural architecture search remains quite costly. To this point, we propose a novel gradient-based framework for efficient architecture search by sharing information across several …
Proposes a new method for clustering tasks in multi-task learning.
problem Improving performance of multiple related prediction tasks.
method Semisoft task clustering approach with a three-step algorithm.
result Validation of the proposed approach on synthetic and real-world datasets.
Novelty search in low-dimensional space improves sample efficiency in exploration tasks.
problem Efficient exploration in complex environments with sparse rewards.
method Combines model-based and model-free objectives to learn a low-dimensional representation. Uses intrinsic novelty rewards based on nearest neighbor distances in this space.
result Our approach achieves more sample-efficient exploration compared to strong baselines on various tasks.
Auxiliary Tuning adapts pre-trained models for novel tasks efficiently.
problem Adapting pre-trained models for new tasks efficiently.
method Supplementing pre-trained model with an auxiliary model that shifts output distribution.
result Achieved similar results to training from scratch with fewer resources.
TAWT improves cross-task learning efficiency and guarantees.
problem Improving cross-task learning efficiency and theoretical understanding.
method Target-Aware Weighted Training (TAWT) minimizing representation-based task distance.
result TAWT achieves non-asymptotic learning-theoretic guarantees and is effective in NLP tasks.
The successful application of general reinforcement learning algorithms to real-world robotics applications is often limited by their high data requirements. We introduce Regularized Hierarchical Policy Optimization (RHPO) to improve data-efficiency for domains with multiple dominant tasks and ultimately reduce require…
Adaptive data fusion boosts efficiency in multi-task optimization.
problem Multi-task non-smooth optimization in various fields.
method Adaptive data fusion approach leveraging commonalities among objectives.
result Significant improvements in sample efficiency with sharp statistical guarantees.
Task-agnostic RL tackles exploration in MDPs with multiple tasks.
problem Challenges in reinforcement learning with multiple tasks or conflicting objectives.
method Task-agnostic RL framework, UCBZero algorithm.
result UCBZero finds near-optimal policies for multiple tasks efficiently.