arXiv research

Paper discusses flaws in traditional RL for lifelong learning.

Framework for lifelong learning using eigentasks to avoid forgetting and transfer knowledge.

PAC-Bayesian analysis improves lifelong learning in multi-armed bandits.

New method speeds up lifelong learning of complex tasks.

Top 8 robotic vision systems tackled lifelong object recognition challenges.

Paper proposes an algorithm for lifelong learning with shared structure.

Paper converts graph learning to lifelong learning.

Algorithm captures and refines features for efficient lifelong learning.

Builds a novel educational recommender for lifelong learners.

A simple approach improves performance on both past and future tasks in lifelong learning.

Catastrophic forgetting and capacity saturation are the central challenges of any parametric lifelong learning system. In this work, we study these challenges in the context of sequential supervised learning with an emphasis on recurrent neural networks. To evaluate the models in the lifelong learning setting, we propo…

New dataset and benchmarks for lifelong robotic vision tasks.

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that together contribute to the development and specialization of our sensorimotor sk…

DBULL learns new clusters without forgetting past knowledge in streaming unlabelled data.

Transfer learning has received a lot of attention in the machine learning community over the last years, and several effective algorithms have been developed. However, relatively little is known about their theoretical properties, especially in the setting of lifelong learning, where the goal is to transfer information…

Modulating masks improve lifelong reinforcement learning.

Consider the lifelong machine learning paradigm whose objective is to learn a sequence of tasks depending on previous experiences, e.g., knowledge library or deep network weights. However, the knowledge libraries or deep networks for most recent lifelong learning models are with prescribed size, and can degenerate the …

Framework for lifelong learning of compositional structures.

New method for RL tasks transfer using Lipschitz continuity.

New framework SEU solves lifelong learning's catastrophic forgetting issue.

Unified framework supports lifelong learning properties.

Algorithm learns multiple tasks with minimal planning, achieving near-optimal performance.

Knowledge transfer between tasks can improve the performance of learned models, but requires an accurate estimate of the inter-task relationships to identify the relevant knowledge to transfer. These inter-task relationships are typically estimated based on training data for each task, which is inefficient in lifelong …

Graphs evolve; GNNs learn from past tasks.

In many real-world sequential decision making problems, the number of available actions (decisions) can vary over time. While problems like catastrophic forgetting, changing transition dynamics, changing rewards functions, etc. have been well-studied in the lifelong learning literature, the setting where the action set…

AOP combines model-based planning with model-free learning to handle lifelong learning challenges.

Lifelong learning can be viewed as a continuous transfer learning procedure over consecutive tasks, where learning a given task depends on accumulated knowledge --- the so-called knowledge base. Most published work on lifelong learning makes a batch processing of each task, implying that a data collection step is requi…

Develops RL algorithm for lifelong non-stationary environments.

In lifelong learning, the learner is presented with a sequence of tasks, incrementally building a data-driven prior which may be leveraged to speed up learning of a new task. In this work, we investigate the efficiency of current lifelong approaches, in terms of sample complexity, computational and memory cost. Towards…

PETAL adapts models to changing target domains over time.

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian optimization (BO) algorithm designed to solve the problem of model selection for data…

Current deep neural networks can achieve remarkable performance on a single task. However, when the deep neural network is continually trained on a sequence of tasks, it seems to gradually forget the previous learned knowledge. This phenomenon is referred to as \textit{catastrophic forgetting} and motivates the field c…

Algorithm integrates uncertainty for lifelong learning in dynamic environments.

The paper tackles lifelong learning in multi-armed bandits, aiming to minimize average regret over multiple tasks.

A model for deciding which facts to remember in a lifelong learning scenario.

We organized a competition on Autonomous Lifelong Machine Learning with Drift that was part of the competition program of NeurIPS 2018. This data driven competition asked participants to develop computer programs capable of solving supervised learning problems where the i.i.d. assumption did not hold. Large data sets w…

L2SC improves spectral clustering performance by selectively transferring knowledge across tasks.

BatchEnsemble reduces ensemble costs by 3X in training and testing.

Lifelong learning is the problem of learning multiple consecutive tasks in a sequential manner, where knowledge gained from previous tasks is retained and used to aid future learning over the lifetime of the learner. It is essential towards the development of intelligent machines that can adapt to their surroundings. I…

We present a neurosymbolic framework for the lifelong learning of algorithmic tasks that mix perception and procedural reasoning. Reusing high-level concepts across domains and learning complex procedures are key challenges in lifelong learning. We show that a program synthesis approach that combines gradient descent w…

We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on the family of kernels used for learning, solving several related tasks simultaneou…

Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of biological memory transfer to arrive at AI algorithms for memory consolidation and repl…

SONAR improves outlier detection for streaming data with strong theoretical guarantees.

This thesis tackles large-scale learning with kernel methods and proposes scalable algorithms for lifelong robot learning.

TrueLearn uses Bayesian algorithms to match learners with educational resources.

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper, we propose a new kind of connectionist architecture, the Sequential Neural Coding…

LIBO optimizes repeated bandit tasks without prior knowledge or regret.

We consider the problem of transfer learning in an online setting. Different tasks are presented sequentially and processed by a within-task algorithm. We propose a lifelong learning strategy which refines the underlying data representation used by the within-task algorithm, thereby transferring information from one ta…