Skip to content

Entropy-based Stability-Plasticity for Lifelong Learning

Notifications You must be signed in to change notification settings

vgaraujov/ESP-CL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Entropy-based Stability-Plasticity for Lifelong Learning

This repository contains the implementation of ESP.

Requirements

  • torch 1.10.0
  • transformers 3.0.2

Natural Language Experiment

Run the following command to train the model:

$ bash run_nlp.sh

To get it to work, it is mandatory to update the DATA_DIR and OUTPUT_DIR directories of the run_nlp.sh file. Also, it is possible to choose the execution order by setting the ORDER variable. On the other hand, you can modify some parameters for ESP training.

  • mem_capacity: replay set size from 0 to 1
  • only_mem: activate to use ONLY setup (See Section 4.1 of the paper)
  • dynamic_freeze: allow freezing layers on-the-fly

Computer Vision Experiment

Run the following command to train the model:

$ bash run_cv.sh

One can modify some parameters for ESP training.

  • use_highway: activate to use the branch classifiers to the model
  • pretrained: activate to use a pre-trained ResNet-18
  • train_highway_only: activate to use a ONLY the memory to train the branch classifiers
  • mem_per_tasks: amount of element per task to save in memory
  • only_mem: activate to use ONLY the memory to train the model

About

Entropy-based Stability-Plasticity for Lifelong Learning

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published