Incremental Learning with Maximum Entropy Regularization: Rethinking Forgetting and Intransigencecs.LG
Proposes MEDIC to improve incremental learning by preventing forgetting and intransigence.
problem Challenges of forgetting old knowledge and intransigence on new knowledge in incremental learning.
method Maximum Entropy Regularizer (MER) and DropOut Sampling (DOS) to penalize uncertain knowledge and reduce class imbalance.
result Proposed method 'MEDIC' outperforms state-of-the-art algorithms in accuracy, forgetting, and intransigence.