Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat/prepare twitch part3 #239

Draft
wants to merge 105 commits into
base: master
Choose a base branch
from
Draft

Feat/prepare twitch part3 #239

wants to merge 105 commits into from

Commits on Oct 31, 2020

  1. Add Offline-RL support

    @araffin
    araffin committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    182e3d4 View commit details
    Browse the repository at this point in the history

  2. Deactivate logging for offline RL

    @araffin
    araffin committed Oct 31, 2020
    Configuration menu
    Copy the full SHA
    a165b73 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2020

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Nov 29, 2020
    Configuration menu
    Copy the full SHA
    3ab448e View commit details
    Browse the repository at this point in the history

  2. Update d3rlpy wrapper

    @araffin
    araffin committed Nov 29, 2020
    Configuration menu
    Copy the full SHA
    49f1c4e View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Feb 7, 2021
    Configuration menu
    Copy the full SHA
    c8cff9f View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2021

  1. Update hyperparams

    @araffin
    araffin committed Feb 14, 2021
    Configuration menu
    Copy the full SHA
    569d4b4 View commit details
    Browse the repository at this point in the history

  2. Update buffer size

    @araffin
    araffin committed Feb 14, 2021
    Configuration menu
    Copy the full SHA
    b926f9d View commit details
    Browse the repository at this point in the history

  3. Add support for residual RL

    @araffin
    araffin committed Feb 14, 2021
    Configuration menu
    Copy the full SHA
    fee7909 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2021

  1. Update README

    @araffin
    araffin committed Feb 15, 2021
    Configuration menu
    Copy the full SHA
    cd5e4b4 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Feb 16, 2021
    Configuration menu
    Copy the full SHA
    a1d6094 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2021

  1. test with ppo

    @araffin
    araffin committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    2e8a072 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2021

  1. Update d3rlpy

    @araffin
    araffin committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    4fc0864 View commit details
    Browse the repository at this point in the history

  2. Fix for CRR

    @araffin
    araffin committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    d335335 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2021

  1. Fix pushed to d3rlpy

    @araffin
    araffin committed Feb 24, 2021
    Configuration menu
    Copy the full SHA
    49909ef View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2021

  1. Handle keyboard interrupt

    @araffin
    araffin committed Feb 26, 2021
    Configuration menu
    Copy the full SHA
    fefc3bd View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    a2dd644 View commit details
    Browse the repository at this point in the history

  2. Upgrade SB3 + add d3rlpy as requirement

    @araffin
    araffin committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    03e682d View commit details
    Browse the repository at this point in the history

  3. Add CMAES

    @araffin
    araffin committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    87b65aa View commit details
    Browse the repository at this point in the history

  4. Fixes

    @araffin
    araffin committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    0f7fd0d View commit details
    Browse the repository at this point in the history

  5. Copy to avoid modification by reference

    @araffin
    araffin committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    d24842e View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    a9a45f4 View commit details
    Browse the repository at this point in the history

  2. Start support for d3rlpy

    @araffin
    araffin committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    c1dea20 View commit details
    Browse the repository at this point in the history

  3. Add net_arch for BC

    @araffin
    araffin committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    df80a26 View commit details
    Browse the repository at this point in the history

  4. Bug fixes

    @araffin
    araffin committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    a4d1c8b View commit details
    Browse the repository at this point in the history

  5. Use best candidate only once

    @araffin
    araffin committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    8c98c3c View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2021

  1. Remove HER

    @araffin
    araffin committed Apr 5, 2021
    Configuration menu
    Copy the full SHA
    c963be2 View commit details
    Browse the repository at this point in the history

  2. Add basic support for refactored HER

    @araffin
    araffin committed Apr 5, 2021
    Configuration menu
    Copy the full SHA
    40ce4c5 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2021

  1. Add TQC

    @araffin
    araffin committed Apr 7, 2021
    Configuration menu
    Copy the full SHA
    7fad104 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Apr 14, 2021
    Configuration menu
    Copy the full SHA
    da56dff View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Apr 19, 2021
    Configuration menu
    Copy the full SHA
    7105a55 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2021

  1. Integrate RL Racing

    @araffin
    araffin committed Apr 20, 2021
    Configuration menu
    Copy the full SHA
    f6b9b43 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2021

  1. Use TQC

    @araffin
    araffin committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    03af926 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2021

  1. Add space engineer env

    @araffin
    araffin committed Apr 27, 2021
    Configuration menu
    Copy the full SHA
    b4d26c9 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2021

  1. Merge branch 'master' into refactor/her

    @araffin
    araffin committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    76b40d6 View commit details
    Browse the repository at this point in the history

  2. Update hyperparams

    @araffin
    araffin committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    e7e9ee6 View commit details
    Browse the repository at this point in the history

  3. Fix hyperparam

    @araffin
    araffin committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    ae706eb View commit details
    Browse the repository at this point in the history

Commits on May 3, 2021

  1. Merge branch 'master' into refactor/her

    @araffin
    araffin committed May 3, 2021
    Configuration menu
    Copy the full SHA
    d079811 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed May 3, 2021
    Configuration menu
    Copy the full SHA
    3dad1ed View commit details
    Browse the repository at this point in the history

Commits on May 4, 2021

  1. Removed unused callback

    @araffin
    araffin committed May 4, 2021
    Configuration menu
    Copy the full SHA
    73bea6e View commit details
    Browse the repository at this point in the history

  2. Update CI

    @araffin
    araffin committed May 4, 2021
    Configuration menu
    Copy the full SHA
    7e96e10 View commit details
    Browse the repository at this point in the history

  3. Add partial support for parallel training

    @araffin
    araffin committed May 4, 2021
    Configuration menu
    Copy the full SHA
    7c4f1bc View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/parallel-train' into feat/offline-RL

    @araffin
    araffin committed May 4, 2021
    Configuration menu
    Copy the full SHA
    cfa30b5 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2021

  1. Try parallel training

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    5f7980f View commit details
    Browse the repository at this point in the history

  2. Cleanup

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    b635157 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/parallel-train' into feat/offline-RL

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    55ad418 View commit details
    Browse the repository at this point in the history

  4. Add notes

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    76ea2ea View commit details
    Browse the repository at this point in the history

  5. Avoid modify by reference + add sleep time

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    2966689 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feat/parallel-train' into feat/offline-RL

    @araffin
    araffin committed May 5, 2021
    Configuration menu
    Copy the full SHA
    5f9e044 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2021

  1. Take learning starts into account

    @araffin
    araffin committed May 6, 2021
    Configuration menu
    Copy the full SHA
    aa6d934 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/parallel-train' into feat/offline-RL

    @araffin
    araffin committed May 6, 2021
    Configuration menu
    Copy the full SHA
    c2baee5 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2021

  1. Merge branch 'master' into misc/veridream

    @araffin
    araffin committed May 10, 2021
    Configuration menu
    Copy the full SHA
    76ecb24 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/parallel-train' into misc/veridream

    @araffin
    araffin committed May 10, 2021
    Configuration menu
    Copy the full SHA
    54d5596 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2021

  1. Update hyperparams

    @araffin
    araffin committed May 11, 2021
    Configuration menu
    Copy the full SHA
    563d853 View commit details
    Browse the repository at this point in the history

  2. Add dict obs support

    @araffin
    araffin committed May 11, 2021
    Configuration menu
    Copy the full SHA
    779c4c6 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2021

  1. Update test env

    @araffin
    araffin committed May 12, 2021
    Configuration menu
    Copy the full SHA
    43188ad View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into refactor/her

    @araffin
    araffin committed May 12, 2021
    Configuration menu
    Copy the full SHA
    20c5dd8 View commit details
    Browse the repository at this point in the history

  3. Version bump

    @araffin
    araffin committed May 12, 2021
    Configuration menu
    Copy the full SHA
    b461048 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'refactor/her' into misc/veridream

    @araffin
    araffin committed May 12, 2021
    Configuration menu
    Copy the full SHA
    15c8fa1 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into misc/veridream

    @araffin
    araffin committed May 12, 2021
    Configuration menu
    Copy the full SHA
    4857bca View commit details
    Browse the repository at this point in the history

Commits on May 14, 2021

  1. Update for symmetric control + catch zmq error

    @araffin
    araffin committed May 14, 2021
    Configuration menu
    Copy the full SHA
    f73a65e View commit details
    Browse the repository at this point in the history

Commits on May 15, 2021

  1. Save best model

    @araffin
    araffin committed May 15, 2021
    Configuration menu
    Copy the full SHA
    da441b8 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2021

  1. Fix parallel save (maybe issue with optimizer)

    @araffin
    araffin committed May 16, 2021
    Configuration menu
    Copy the full SHA
    bf05e92 View commit details
    Browse the repository at this point in the history

  2. Update hyperparams

    @araffin
    araffin committed May 16, 2021
    Configuration menu
    Copy the full SHA
    a9d63db View commit details
    Browse the repository at this point in the history

Commits on May 17, 2021

  1. Update best params

    @araffin
    araffin committed May 17, 2021
    Configuration menu
    Copy the full SHA
    d395120 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2021

  1. Update hyperparams

    @araffin
    araffin committed May 19, 2021
    Configuration menu
    Copy the full SHA
    5634128 View commit details
    Browse the repository at this point in the history

  2. Prepare big network experiment

    @araffin
    araffin committed May 19, 2021
    Configuration menu
    Copy the full SHA
    c5b7f55 View commit details
    Browse the repository at this point in the history

  3. Revert to normal net

    @araffin
    araffin committed May 19, 2021
    Configuration menu
    Copy the full SHA
    976833d View commit details
    Browse the repository at this point in the history

  4. Add exception for windows

    @araffin
    araffin committed May 19, 2021
    Configuration menu
    Copy the full SHA
    c6b2dce View commit details
    Browse the repository at this point in the history

  5. Update plot script: allow multiple envs

    @araffin
    araffin committed May 19, 2021
    Configuration menu
    Copy the full SHA
    6703390 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2021

  1. Add bert params

    @araffin
    araffin committed May 21, 2021
    Configuration menu
    Copy the full SHA
    a771249 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2021

  1. Save multirobot hyperparams

    @araffin
    araffin committed May 26, 2021
    Configuration menu
    Copy the full SHA
    c966371 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2021

  1. Merge branch 'master' into misc/veridream

    @araffin
    araffin committed May 27, 2021
    Configuration menu
    Copy the full SHA
    f6f3dd0 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    7f24273 View commit details
    Browse the repository at this point in the history

  2. Remove CMAES

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    7dc1b3a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'misc/veridream' into feat/offline-RL

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    1f75be3 View commit details
    Browse the repository at this point in the history

  4. Update params for newer machine

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    61925cb View commit details
    Browse the repository at this point in the history

  5. Re-add timelimit

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    fe58ab0 View commit details
    Browse the repository at this point in the history

  6. Re-add monitor

    @araffin
    araffin committed May 29, 2021
    Configuration menu
    Copy the full SHA
    9b71984 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2021

  1. Add POC for VecEnvWrapper

    @araffin
    araffin committed May 30, 2021
    Configuration menu
    Copy the full SHA
    9065a2a View commit details
    Browse the repository at this point in the history

  2. Update params

    @araffin
    araffin committed May 30, 2021
    Configuration menu
    Copy the full SHA
    6cc8256 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    fedbde7 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2021

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Jun 29, 2021
    Configuration menu
    Copy the full SHA
    80f4df1 View commit details
    Browse the repository at this point in the history

  2. Fixes

    @araffin
    araffin committed Jun 29, 2021
    Configuration menu
    Copy the full SHA
    a8d25b3 View commit details
    Browse the repository at this point in the history

  3. Format

    @araffin
    araffin committed Jun 29, 2021
    Configuration menu
    Copy the full SHA
    5530171 View commit details
    Browse the repository at this point in the history

  4. Fix loading

    @araffin
    araffin committed Jun 29, 2021
    Configuration menu
    Copy the full SHA
    a2244f0 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2022

  1. Cleanup hyperparams

    @araffin
    araffin committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    ab98711 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Jan 4, 2022
    Configuration menu
    Copy the full SHA
    57c0d50 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2022

  1. Sync vec normalize for parallel training

    @araffin
    araffin committed Jan 7, 2022
    Configuration menu
    Copy the full SHA
    df89b55 View commit details
    Browse the repository at this point in the history

  2. Update params

    @araffin
    araffin committed Jan 7, 2022
    Configuration menu
    Copy the full SHA
    da26cb9 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2022

  1. Add episode length plot

    @araffin
    araffin committed Jan 8, 2022
    Configuration menu
    Copy the full SHA
    3655b90 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2022

  1. Add hack when VecNormalize was not saved

    @araffin
    araffin committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    24d3f89 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/offline-RL' of github.com:DLR-RM/rl-baselines3-zoo… 

    … into feat/offline-RL
    @araffin
    araffin committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    053f3b4 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2022

  1. Add websocket wait

    @araffin
    araffin committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    a5832e4 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2022

  1. Fix bool conversion

    @araffin
    araffin committed Jan 15, 2022
    Configuration menu
    Copy the full SHA
    54cc4d0 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2022

  1. Merge branch 'master' into feat/offline-RL

    @araffin
    araffin committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    a4e37d1 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2022

  1. Save edits from live

    @araffin
    araffin committed Apr 5, 2022
    Configuration menu
    Copy the full SHA
    3e2761e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/live-twitch

    @araffin
    araffin committed Apr 5, 2022
    Configuration menu
    Copy the full SHA
    988bf7b View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2022

  1. Save new callback and wrapper

    @araffin
    araffin committed Apr 9, 2022
    Configuration menu
    Copy the full SHA
    6497088 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2022

  1. Disable continuity wrapper and add expln trick

    @araffin
    araffin committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    6a2dc31 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2022

  1. Merge remote-tracking branch 'origin/master' into feat/prepare-twitch… 

    …-part3
    @araffin
    araffin committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    75c4054 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2022

  1. Update default

    @araffin
    araffin committed Apr 17, 2022
    Configuration menu
    Copy the full SHA
    5cb5e1d View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2022

  1. Save edits from live

    @araffin
    araffin committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    987e34d View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2022

  1. Flush only when new lap is detected

    @araffin
    araffin committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    c7f218f View commit details
    Browse the repository at this point in the history

  2. Update sac params

    @araffin
    araffin committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    d415090 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2022

  1. Merge branch 'master' into feat/prepare-twitch-part3

    @araffin
    araffin committed Jun 3, 2022
    Configuration menu
    Copy the full SHA
    de982ba View commit details
    Browse the repository at this point in the history