FCL3 learns from multiple representative models to adapt to new tasks.
problem Degradation of performance in lifelong learning models for new task environments.
method Two knowledge libraries: feature learning and model knowledge. Self-selection of representative models for new tasks.
result FCL3 achieves better performance than most lifelong learning frameworks.
DBULL learns new clusters without forgetting past knowledge in streaming unlabelled data.
problem Challenges in Unsupervised Lifelong Learning with evolving data distributions and class labels.
method Bayesian framework for incremental learning, Deep Bayesian Unsupervised Lifelong Learning (DBULL) algorithm, knowledge preservation mechanism, automatic cluster discovery.
result DBULL can progressively discover new clusters without forgetting past knowledge in unlabelled data.
L2SC improves spectral clustering performance by selectively transferring knowledge across tasks.
problem L2SC tackles the challenge of incorporating new spectral clustering tasks without relearning all previous tasks.
method L2SC uses an orthogonal basis library and feature embedding library to selectively transfer knowledge from previously learned tasks to new tasks.
result L2SC outperforms state-of-the-art spectral clustering algorithms on real-world benchmark datasets.
Paper discusses flaws in traditional RL for lifelong learning.
problem Traditional RL fails to model lifelong learning systems.
method Simplified prototype of lifelong RL system.
result Insights into lifelong RL, showing traditional RL's limitations.
Framework for lifelong learning using eigentasks to avoid forgetting and transfer knowledge.
problem Avoiding forgetting and transferring knowledge in lifelong learning.
method Eigentask framework: skills paired with generative models, wake-sleep cycle for learning and consolidation.
result Improved performance in supervised continual learning, evidence of forward knowledge transfer.
PAC-Bayesian analysis improves lifelong learning in multi-armed bandits.
problem Improving lifelong learning in multi-armed bandits.
method PAC-Bayesian analysis for deriving lower bounds and proposing lifelong learning algorithms.
result Proposed algorithms outperform baseline methods in lifelong multi-armed bandit problems.
New method speeds up lifelong learning of complex tasks.
problem Catastrophic forgetting in lifelong learning.
method Directly trains lifelong function approximators via policy gradients.
result Faster convergence and better policies achieved.
Top 8 robotic vision systems tackled lifelong object recognition challenges.
problem Lifelong learning in robotic vision for varied, dynamic environments.
method Design of a dataset with diverse conditions and rules for evaluation.
result Robotic vision systems improved over time with dynamic object appearances.
Unified approach for lifelong learning in recurrent neural networks.
problem Catastrophic forgetting and capacity saturation in lifelong learning.
method Proposed a curriculum-based benchmark and unified model combining Gradient Episodic Memory and Net2Net.
result Unified model performs better than constituent models in lifelong learning setting.
Paper proposes an algorithm for lifelong learning with shared structure.
problem Lifelong learning with shared structure in an online setting.
method Proposes a simple algorithm using multi-task empirical risk minimization.
result Establishes a sample complexity bound based on task-eluder dimension.
Paper converts graph learning to lifelong learning.
problem Learning graphs in a streaming fashion.
method Feature graph topology, converting node classification to graph classification.
result FGN achieves superior performance in lifelong human action recognition and feature matching.
Algorithm captures and refines features for efficient lifelong learning.
problem Efficiently learning multiple tasks sequentially with limited data.
method Proposes a lifelong learning algorithm that maintains and refines internal feature representation.
result Proves sample complexity improvement and matches lower bound for efficiency.
Builds a novel educational recommender for lifelong learners.
problem Challenges in creating scalable and transparent models for lifelong learning.
method Integrative approach combining content novelty, background knowledge, and learner engagement.
result TrueLearn achieves promising performance while retaining a human interpretable learner model.
A simple approach improves performance on both past and future tasks in lifelong learning.
problem Forgetting in lifelong learning, where performance on past tasks degrades when learning new tasks.
method Representation ensembling to improve performance on both future and past tasks.
result Representation ensembling demonstrates both forward and backward transfer across various datasets.
AutoML challenge solved lifelong learning problems without i.i.d. data.
problem Designing lifelong learning systems without independent and identically distributed data.
method Developed and evaluated machine learning programs using CodaLab platform.
result More than 300 participants competed and solved complex lifelong learning problems.
New dataset and benchmarks for lifelong robotic vision tasks.
problem Challenges in applying computer vision to robots, especially lifelong learning.
method Provided a new lifelong robotic vision dataset and benchmarks.
result Demonstrated the complexity and bottlenecks in lifelong object recognition.
Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that together contribute to the development and specialization of our sensorimotor sk…
Transfer learning has received a lot of attention in the machine learning community over the last years, and several effective algorithms have been developed. However, relatively little is known about their theoretical properties, especially in the setting of lifelong learning, where the goal is to transfer information…
Modulating masks improve lifelong reinforcement learning.
problem Catastrophic forgetting and task interference in lifelong reinforcement learning.
method Adapted modulating masks for deep lifelong reinforcement learning (LRL) with PPO and IMPALA agents.
result Superior performance in both discrete and continuous RL tasks compared to LRL baselines.
A new lifelong online learning framework combining current and accumulated knowledge.
problem Continuous learning over tasks with limited data and unknown number of instances.
method Interactive learning algorithm combining current task information and accumulated knowledge.
result Algorithm can benefit from small cumulative error even with few interactions.
Framework for lifelong learning of compositional structures.
problem Learning to reuse self-contained chunks of knowledge for novel problems.
method Separates learning into combining existing components and adapting them.
result Framework handles trade-off between stability and flexibility.
A-GEM improves lifelong learning efficiency with minimal computational and memory cost.
problem Efficiency in lifelong learning with incremental task exposure.
method Introducing A-GEM, a new version of GEM, with a novel evaluation protocol and metric.
result A-GEM achieves the best trade-off between accuracy and efficiency in lifelong learning benchmarks.
New method for RL tasks transfer using Lipschitz continuity.
problem Knowledge transfer in RL tasks over time.
method Established Lipschitz continuity between MDPs and applied it to RL.
result Improved convergence rate and no negative transfer with high probability.
New framework SEU solves lifelong learning's catastrophic forgetting issue.
problem Catastrophic forgetting in lifelong learning.
method Introduces Neural Architecture Search into lifelong learning to dynamically adapt model structures for different tasks.
result Achieves higher accuracy with significantly smaller model size (25-33% of state-of-the-art methods).
New algorithm adapts to changing action sets in sequential decision making.
problem Adapting to a changing action set in sequential decision making problems.
method Breaks the problem into inferring action structure and optimizing policy.
result Demonstrates efficiency on real-world lifelong learning problems.
New schemes improve lifelong learning by balancing old and new tasks.
problem Catastrophic forgetting in deep neural networks when learning multiple tasks.
method Unified optimization perspective of episodic memory based approaches, introducing MEGA-I and MEGA-II schemes.
result Significant improvement in lifelong learning benchmarks, reducing error by up to 18%.
Unified framework supports lifelong learning properties.
problem Capturing desirable properties of human learning in machine learning.
method Unified framework with one central mechanism.
result Supports almost all desirable properties of human learning.
Algorithm learns multiple tasks with minimal planning, achieving near-optimal performance.
problem Learning multiple tasks efficiently in a reinforcement learning setting.
method UCB Lifelong Value Distillation (UCBlvd) algorithm with structural assumption for shared exploration.
result Sublinear regret bound of i l d e O ( ( d 3 + d ′ d ) H 4 K ) ilde{\mathcal{O}}(\sqrt{(d^3+d^\prime d)H^4K}) i l d e O ( ( d 3 + d ′ d ) H 4 K ) with O ( d H log ( K ) ) \mathcal{O}(dH\log(K)) O ( d H log ( K )) planning calls. Knowledge transfer between tasks can improve the performance of learned models, but requires an accurate estimate of the inter-task relationships to identify the relevant knowledge to transfer. These inter-task relationships are typically estimated based on training data for each task, which is inefficient in lifelong …
Graphs evolve; GNNs learn from past tasks.
problem Learning from evolving graphs and new classes.
method Incremental training method for lifelong learning on graphs.
result Less than 50% of the GNN's receptive field is needed for 95% accuracy.
Adapts Lifelong Learning for Federated Learning to prevent model drift.
problem Federated Learning on non-i.i.d. data leads to model divergence and forgetting.
method Adds a penalty term to the loss function to encourage convergence of local models to a shared optimum.
result The method improves performance in image recognition tasks compared to existing approaches.
Generative memory helps AI learn new tasks without forgetting old ones.
problem Catastrophic forgetting in lifelong reinforcement learning.
method Generative memory model for task-agnostic latent space.
result Generative memory can improve lifelong reinforcement learning performance.
AOP combines model-based planning with model-free learning to handle lifelong learning challenges.
problem Learning control in an online reset-free lifelong learning scenario where mistakes can compound and dynamics change.
method Adaptive Online Planning (AOP) that combines model-based planning with model-free learning, approximating uncertainty to call upon planning only when necessary.
result Achieves strong performance in lifelong learning challenges, gracefully adapting behaviors in the face of unpredictable changes.
Model learns continuously, starting from a blank slate.
problem Lifelong learning starting from zero.
method Inspired by neuroplasticity, the model develops nodes based on four rules: expansion, generalization, forgetting, and backpropagation.
result Better performance in accuracy, energy efficiency, and versatility compared to other models.
Develops RL algorithm for lifelong non-stationary environments.
problem Challenges of reinforcement learning in environments with persistent change.
method Formalizes lifelong non-stationarity, uses latent variable models, and leverages online learning and probabilistic inference.
result Substantial improvement in performance over non-reasoning approaches in lifelong non-stationary environments.
PETAL adapts models to changing target domains over time.
problem Lifelong test-time adaptation in changing target domains.
method Probabilistic framework with student-teacher model and data-driven parameter restoration.
result PETAL achieves better results than state-of-the-art for online lifelong test-time adaptation.
Model learns continuously from text without forgetting.
problem Catastrophic forgetting in lifelong language learning.
method Episodic memory with sparse experience replay and local adaptation.
result Model can continuously learn from new datasets.
New neural network avoids forgetting old knowledge as new data comes in.
problem Catastrophic forgetting in lifelong learning systems.
method Sequential Neural Coding Network, biologically-plausible synapse adaptation, task-executive control mimicry.
result Significantly less forgetting compared to standard neural models in experiments.
LBO optimizes model selection for evolving datasets.
problem Model selection for datasets arriving and evolving over time.
method Online, multitask Bayesian optimization exploiting function correlation.
result LBO outperforms standard BO algorithms on real and synthetic data.
Algorithm integrates uncertainty for lifelong learning in dynamic environments.
problem Continuous, lifelong learning for intelligent agents in changing conditions.
method Inspired by neuromodulatory mechanisms, integrates uncertainty for self-supervised and one-shot learning.
result Stable learning without catastrophic forgetting in a virtual environment.
The paper tackles lifelong learning in multi-armed bandits, aiming to minimize average regret over multiple tasks.
problem Minimizing average regret in multi-armed bandits over multiple tasks.
method Confidence interval tuning of UCB algorithms and greedy algorithms applied to a bandit over bandit approach.
result Empirical improvement over previous work in the mortal bandit problem.
A model for deciding which facts to remember in a lifelong learning scenario.
problem Deciding which facts to retain in limited memory from an endless stream of information.
method Mathematical model based on online learning framework, using multiplicative weights update algorithm with modifications.
result Design of an alternative scheme with close to optimal regret guarantees for memory-constrained lifelong learning.
BatchEnsemble reduces ensemble costs by 3X in training and testing.
problem High costs for training and testing ensembles of neural networks.
method Defines each weight matrix as a Hadamard product of a shared matrix and a rank-one matrix per member.
result Achieves 3X speedup and 3X memory reduction in test time for ensembles of size 4.
Lifelong learning is the problem of learning multiple consecutive tasks in a sequential manner, where knowledge gained from previous tasks is retained and used to aid future learning over the lifetime of the learner. It is essential towards the development of intelligent machines that can adapt to their surroundings. I…
We present a neurosymbolic framework for the lifelong learning of algorithmic tasks that mix perception and procedural reasoning. Reusing high-level concepts across domains and learning complex procedures are key challenges in lifelong learning. We show that a program synthesis approach that combines gradient descent w…
We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on the family of kernels used for learning, solving several related tasks simultaneou…
SONAR improves outlier detection for streaming data with strong theoretical guarantees.
problem Outlier detection for non-stationary streaming data with high Type I/II errors.
method SONAR is an efficient SGD-based OCSVM solver with strong convex regularization and lifelong learning guarantees.
result SONAR outperforms traditional OCSVM in Type I/II error rates under non-stationary data.
This thesis tackles large-scale learning with kernel methods and proposes scalable algorithms for lifelong robot learning.
problem The challenge of scaling kernel methods to large datasets.
method We analyze and develop approximate learning algorithms, including Nyström and random features, to improve scalability.
result Our methods enable robots to learn continuously and adapt to changing environments efficiently.