Unified framework for multi-objective curriculum learning in robotics.
problem Improving sample efficiency and final performance in robotic policy learning.
method Unified automatic curriculum learning framework with multi-task hyper-net and flexible memory mechanism.
result Superior performance compared to state-of-the-art methods in robotic manipulation tasks.
Automatically generates a deep RL curriculum for faster and more stable learning.
problem How to automatically generate a curriculum for deep RL agents.
method Interprets curriculum generation as an inference problem, learning task distributions progressively.
result Curricula significantly improve learning performance across various environments and deep RL algorithms.
This paper introduces CENIE to quantify environment novelty for better UED.
problem Challenges in measuring environment novelty for effective UED.
method CENIE framework using state-action space coverage and Gaussian Mixture Models.
result CENIE improves UED performance across multiple benchmarks.
Paper develops a method to automatically create learning curricula for reinforcement learning.
problem Designing an effective sequence of simpler tasks to prepare for a more complex task.
method Formulated as a Markov Decision Process, extended to handle multiple transfer learning algorithms.
result A curriculum policy can be learned from experience, improving training speed for reinforcement learning agents.
Q-CurL optimizes quantum learning with a curriculum design.
problem Efficiently training quantum models with limited resources.
method Quantum curriculum learning framework.
result Q-CurL enhances training convergence and generalization.
SAMPLR optimizes for ground truth in aleatoric parameters to avoid curriculum-induced covariate shift.
problem Curriculum learning shifts training distribution, leading to suboptimal policies in aleatoric settings.
method SAMPLR optimizes ground-truth utility function, avoiding curriculum-induced covariate shift.
result SAMPLR preserves optimality under ground-truth distribution, promoting robustness across various environments.
This work improves NAT translation accuracy through fine-tuning with curriculum learning.
problem Improving NAT translation accuracy while maintaining inference speed.
method Curriculum learning applied to fine-tuning of a pre-trained AT model to a NAT model.
result Significant improvement in translation accuracy (over 1 BLEU score) and speedup in inference.
CP-DRL improves curriculum reinforcement learning by leveraging causal relationships.
problem Designing effective task sequences for reinforcement learning.
method Causal-Paced Deep Reinforcement Learning (CP-DRL) that approximates SCM differences based on interaction data.
result CP-DRL outperforms existing methods on benchmarks, achieving faster convergence and higher returns.
New syllabuses improve LSTM learning speed but not generalization.
problem Comparing syllabuses for curriculum learning in LSTM networks.
method Empirical comparison of identified syllabuses on three sequential learning tasks.
result Automated curriculum learning approach performs competitively.
We introduce Mix&Match (M&M) - a training framework designed to facilitate rapid and effective learning in RL agents, especially those that would be too slow or too challenging to train otherwise. The key innovation is a procedure that allows us to automatically form a curriculum over agents. Through such a curriculum …
MaMiC proposes a dual curriculum for robot manipulation tasks with sparse rewards.
problem Overcoming exploratory constraints in robot manipulation tasks with sparse rewards.
method Includes a macro curriculum scheme and a micro curriculum scheme to guide learning.
result Combining macro and micro curriculum strategies improves performance in robot manipulation tasks.
By simulating the easy-to-hard learning manners of humans/animals, the learning regimes called curriculum learning~(CL) and self-paced learning~(SPL) have been recently investigated and invoked broad interests. However, the intrinsic mechanism for analyzing why such learning regimes can work has not been comprehensivel…
Paper introduces a new curriculum generation method for reinforcement learning.
problem Improving reinforcement learning performance and speed through curriculum learning.
method The paper proposes a novel curriculum generation paradigm based on progression and mapping functions.
result Empirical results show the new approach outperforms state-of-the-art algorithms.
Curriculum learning shows marginal benefits over random ordering on standard datasets.
problem Investigating the benefits of curriculum learning over random ordering in training neural networks.
method Experiments with curriculum, anti-curriculum, and random-curriculum orderings on various datasets and conditions.
result Curriculum learning only marginally improves performance on standard datasets and is outperformed by random ordering.
Analyzes when and why curricula help neural networks learn.
problem Why and when does curriculum learning help neural networks?
method Statistical physics methods applied to a neural network model.
result Curricula can modestly speed up learning but do not provide generalization benefit.
Automatically generates curricula for reinforcement learning agents.
problem Learning in dynamic, sparse reward environments.
method Setter-solver paradigm focusing on goal validity, feasibility, and coverage.
result Demonstrated success in 2D and 3D environments with varying goals.
Curriculum learning speeds up agent learning in Minecraft, a complex visual domain.
problem Training agents to learn multiple tasks in a complex, visual domain.
method Learning-progress based curriculum and dynamic exploration bonuses.
result Curriculum learning improves agent performance in a complex reinforcement learning problem.
Optimizes task sequencing in reinforcement learning to improve exploration and policy discovery.
problem Improving exploration and policy discovery in reinforcement learning.
method General optimization framework for task sequencing using different objective functions.
result Curriculum learning can improve initial performance, reduce suboptimal actions, and discover better policies.
New algorithm combines curriculum learning with HER for complex object manipulation tasks.
problem Learning complex sequential object manipulation tasks from scratch is challenging.
method Curriculum learning with Hindsight Experience Replay (HER) for recurrent object manipulation tasks.
result Significant improvement in learning sequential object manipulation tasks compared to vanilla-HER.
Curriculum learning and imitation learning improve control over financial time-series data.
problem Improving control performance over complex financial time-series data.
method Data augmentation for curriculum learning and policy distillation for imitation learning.
result Curriculum learning shows significant improvement over time-series control tasks.
This paper introduces curriculum loss to improve robustness and generalization in deep neural networks against label corruption.
problem Improving robustness and generalization in deep neural networks against label corruption.
method Proposes curriculum loss, a tighter upper bound of the 0-1 loss, which optimizes robust properties while adaptively selecting samples.
result Curriculum loss enhances robustness and generalization in deep neural networks compared to conventional losses.
Improved reinforcement learning by using a structured training curriculum.
problem Machine learning players learn from the entire game at all times, not using a structured training curriculum.
method Employing an end-game-first training curriculum to train an AlphaZero inspired player.
result The rate of learning of an artificial player can be improved during the early stages of training.
Curriculum learning improves deep generative models for noisy data.
problem Training deep generative models with noisy data is challenging.
method Proposes a curriculum learning algorithm based on data point centrality.
result The algorithm learns optimal generative models for noisy data.
The paper studies the benefits of curriculum learning in linear regression tasks.
problem Theoretical understanding of curriculum learning's benefits in machine learning.
method Theoretical analysis of curriculum learning in structured and unstructured multitask linear regression problems.
result Adaptive learning in the unstructured setting is fundamentally harder than oracle learning, but not in the structured setting.
Study evaluates task selection policies for multitask learning.
problem How to allocate training resources among multiple tasks.
method Empirical evaluation of task selection policies in synthetic and real-world settings.
result Improved model performance through counterfactual estimation.
Proposes a motif-preserving Graph Neural Network for financial default prediction.
problem Weak connectivity and imbalance in motif patterns in graph-based models.
method MotifGNN with curriculum learning to capture higher-order topology structures.
result Significantly improved financial default prediction accuracy on public and industrial datasets.
In this paper, we investigate a new form of automated curriculum learning based on adaptive selection of accuracy requirements, called accuracy-based curriculum learning. Using a reinforcement learning agent based on the Deep Deterministic Policy Gradient algorithm and addressing the Reacher environment, we first show …
This work analyzes how curriculum learning improves deep network training.
problem Training deep networks with non-uniform sampling of mini-batches.
method Two methods to address curriculum learning: transfer learning and bootstrapping. Different pacing functions to guide mini-batch sampling.
result Curriculum learning leads to faster learning and better final performance.
Survey on curriculum learning for reinforcement learning.
problem Efficiently learning complex tasks in reinforcement learning.
method Framework for curriculum learning in reinforcement learning.
result Survey and classification of existing CL methods.
Curriculum learning strategies improve GAN training speed and quality.
problem Training GANs is notoriously difficult and time-consuming.
method Proposes three curriculum learning strategies based on difficulty scores.
result Curriculum learning strategies lead to faster convergence and superior results.
EPC curriculum improves MARL performance as agent population grows.
problem Challenges in learning good policies for large multi-agent systems.
method Evolutionary Population Curriculum (EPC) for scaling MARL.
result EPC consistently outperforms baselines as agent population increases.
Curriculum learning improves model training efficiency and performance.
problem Expensive training of reasoning models using human or synthetic data.
method Autocurriculum, where models use their own performance to decide training problems.
result Autocurriculum reduces training costs and improves model performance.
Paper proposes a curriculum for RL agents to learn from expert demonstrations.
problem Training RL agents efficiently from expert demonstrations.
method Develops a training curriculum that starts from the goal and works backwards.
result Improves sample efficiency for some tasks compared to PPO.
In this paper we introduce Curriculum GANs, a curriculum learning strategy for training Generative Adversarial Networks that increases the strength of the discriminator over the course of training, thereby making the learning task progressively more difficult for the generator. We demonstrate that this strategy is key …
Proposes a curriculum learning algorithm to maximize cumulative return in reinforcement learning.
problem Maximizing cumulative return in reinforcement learning tasks.
method Task sequencing algorithm maximizing cumulative return, using curriculum learning to minimize suboptimal actions.
result Significantly better performance on cumulative return maximization compared to metaheuristic algorithms.
The paper analyzes how curriculum learning improves machine learning performance.
problem Lack of theoretical analysis for curriculum learning in machine learning.
method Formulated an ideal difficulty score and analyzed its contribution in convex problems.
result The expected convergence rate decreases with the ideal difficulty score.
Bi-directional Curriculum Learning improves graph anomaly detection by considering both homogeneity and heterogeneity.
problem Existing graph anomaly detection methods often ignore the different contributions of nodes to training.
method Introduces Bi-directional Curriculum Learning (BCL) to optimize GAD methods by considering both homogeneity and heterogeneity of nodes.
result Extensive experiments show that BCL significantly improves the performance of GAD anomaly detection models.
New method learns optimal environment and goal difficulty for reinforcement learning.
problem Lack of robust transfer in reinforcement learning.
method Self-Supervised Active Domain Randomization (SS-ADR).
result Optimal domain randomization strategy improves transfer in goal-directed tasks.
ACL improves DRL by adapting task difficulty to agent's capabilities.
problem Improving sample efficiency and performance in DRL.
method Adapting task difficulty based on agent's capacity.
result Enhanced sample efficiency and asymptotic performance.
Curriculum learning helps neural networks learn parities more efficiently.
problem Improving learning efficiency for neural networks on parity targets.
method Using a curriculum learning approach with a mixture of sparse and dense inputs.
result A 2-layer ReLU neural network can learn parities more efficiently than a fully connected network.
Recent variants improve knowledge distillation performance.
problem Improving the performance of knowledge distillation.
method Introducing additional components or changing the learning process.
result These variants have shown promising results.
Extracting a curriculum from a teacher network improves distillation efficiency.
problem Efficiently training a small network using a large teacher network's output.
method Random projection of teacher network's hidden representations to progressively train the student network.
result Extracted curriculum significantly outperforms one-shot distillation and achieves similar performance to progressive distillation.
Improves reinforcement learning for complex tasks with sparse feedback.
problem Learning optimal policies from sparse feedback is challenging.
method Three algorithms based on Hindsight Experience Replay (HER) to improve performances.
result Vast improvement in final success rate and sample efficiency.
Proposes a new curriculum learning approach to improve deep RL agent generalization.
problem Challenges in training deep RL agents to generalize over unseen situations.
method Two-stage curriculum learning approach: teacher learns high-exploration curriculum, distills priors to generate expert curriculum.
result 50% improvement in average performance over state-of-the-art methods.
RLVR training dynamics reveal an implicit curriculum that shapes learning progression.
problem Understanding how RLVR overcomes the long-horizon barrier.
method Developed a theory of training dynamics for RLVR on transformers, using Fourier analysis on finite groups.
result Mixed-difficulty training naturally follows an implicit curriculum, shaping the learning progression from easy to hard.
RLVR learning dynamics naturally create an implicit curriculum for transformers.
problem How rewards based on final outcomes help overcome the long-horizon barrier in reasoning models.
method Developed a theory of training dynamics for RLVR on transformers, using Fourier analysis on finite groups.
result Mixed-difficulty training induces an implicit curriculum that shapes the learning progression from easy to hard.
Improved financial forecasts with deep neural networks and curriculum learning.
problem Scaling traditional forecasting models for high-granularity financial data.
method Applied Encoder-Decoder LSTMs and Dilated CNNs from NLP and CV, with curriculum learning.
result Approximately 30% improvement in forecast accuracy compared to traditional methods.
New algorithm outperforms existing ones by focusing on mastering rate.
problem Low sample efficiency in learning progress-based algorithms.
method Proposes a new algorithm based on mastering rate.
result Significantly outperforms learning progress-based algorithms.