-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dictionary Observations #243
Commits on Nov 24, 2020
-
Configuration menu - View commit details
-
Copy full SHA for c8d0914 - Browse repository at this point
Copy the full SHA c8d0914View commit details
Commits on Nov 25, 2020
-
Configuration menu - View commit details
-
Copy full SHA for b7f3386 - Browse repository at this point
Copy the full SHA b7f3386View commit details
Commits on Nov 26, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 21fecd3 - Browse repository at this point
Copy the full SHA 21fecd3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2a1c14 - Browse repository at this point
Copy the full SHA b2a1c14View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1cda60b - Browse repository at this point
Copy the full SHA 1cda60bView commit details
Commits on Nov 27, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 8a04e61 - Browse repository at this point
Copy the full SHA 8a04e61View commit details -
Configuration menu - View commit details
-
Copy full SHA for 86b3c14 - Browse repository at this point
Copy the full SHA 86b3c14View commit details -
added slow dict test. Added SACMultiInputPolicy for future. Added pri…
…vate static image transpose helper to common policy
Configuration menu - View commit details
-
Copy full SHA for f60d439 - Browse repository at this point
Copy the full SHA f60d439View commit details -
Merge branch 'feat/dict_observations' of https://github.com/J-Travnik…
…/stable-baselines3 into feat/dict_observations
Configuration menu - View commit details
-
Copy full SHA for 3d2e041 - Browse repository at this point
Copy the full SHA 3d2e041View commit details -
Configuration menu - View commit details
-
Copy full SHA for da1de6e - Browse repository at this point
Copy the full SHA da1de6eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 51249da - Browse repository at this point
Copy the full SHA 51249daView commit details
Commits on Nov 30, 2020
-
Adding StackedObservations classes used within VecStackEnvs wrappers.…
… Made test_dict_env shorter and removed slow
Configuration menu - View commit details
-
Copy full SHA for 761a67f - Browse repository at this point
Copy the full SHA 761a67fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3cb69f5 - Browse repository at this point
Copy the full SHA 3cb69f5View commit details
Commits on Dec 1, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 82fe425 - Browse repository at this point
Copy the full SHA 82fe425View commit details -
Configuration menu - View commit details
-
Copy full SHA for 201799d - Browse repository at this point
Copy the full SHA 201799dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 683bbf2 - Browse repository at this point
Copy the full SHA 683bbf2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 887e007 - Browse repository at this point
Copy the full SHA 887e007View commit details
Commits on Dec 2, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 15ceb35 - Browse repository at this point
Copy the full SHA 15ceb35View commit details -
Configuration menu - View commit details
-
Copy full SHA for f9cab8a - Browse repository at this point
Copy the full SHA f9cab8aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b178f4 - Browse repository at this point
Copy the full SHA 5b178f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for d692027 - Browse repository at this point
Copy the full SHA d692027View commit details -
Configuration menu - View commit details
-
Copy full SHA for b5249ec - Browse repository at this point
Copy the full SHA b5249ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b22f96 - Browse repository at this point
Copy the full SHA 8b22f96View commit details -
Configuration menu - View commit details
-
Copy full SHA for 70dfa83 - Browse repository at this point
Copy the full SHA 70dfa83View commit details
Commits on Dec 6, 2020
-
Configuration menu - View commit details
-
Copy full SHA for b2b7d6f - Browse repository at this point
Copy the full SHA b2b7d6fView commit details
Commits on Dec 8, 2020
-
Adding multi-input policies to dqn,td3,a2c. Fixing warnings. Fixed bu…
…g with DictReplayBuffer as Replay buffers use only 1 env
Configuration menu - View commit details
-
Copy full SHA for a006b5a - Browse repository at this point
Copy the full SHA a006b5aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a94e6df - Browse repository at this point
Copy the full SHA a94e6dfView commit details -
Fixing warnings, splitting is_vectorized_observation into multiple fu…
…nctions based on space type
Configuration menu - View commit details
-
Copy full SHA for 12361ae - Browse repository at this point
Copy the full SHA 12361aeView commit details -
Merge branch 'feat/dict_observations' of https://github.com/J-Travnik…
…/stable-baselines3 into feat/dict_observations
Configuration menu - View commit details
-
Copy full SHA for 9c6390b - Browse repository at this point
Copy the full SHA 9c6390bView commit details
Commits on Dec 10, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 51cb4e4 - Browse repository at this point
Copy the full SHA 51cb4e4View commit details
Commits on Dec 14, 2020
-
Configuration menu - View commit details
-
Copy full SHA for ce0f1a4 - Browse repository at this point
Copy the full SHA ce0f1a4View commit details -
Moved envs to envs directory. Moved stacked obs to vec_envs. Started …
…update on documentation
Configuration menu - View commit details
-
Copy full SHA for 9eee82a - Browse repository at this point
Copy the full SHA 9eee82aView commit details
Commits on Dec 16, 2020
-
Configuration menu - View commit details
-
Copy full SHA for c6a8705 - Browse repository at this point
Copy the full SHA c6a8705View commit details -
Configuration menu - View commit details
-
Copy full SHA for c3d2138 - Browse repository at this point
Copy the full SHA c3d2138View commit details
Commits on Jan 4, 2021
-
Configuration menu - View commit details
-
Copy full SHA for c893faa - Browse repository at this point
Copy the full SHA c893faaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 935cef9 - Browse repository at this point
Copy the full SHA 935cef9View commit details
Commits on Jan 6, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a07497b - Browse repository at this point
Copy the full SHA a07497bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 96d1e64 - Browse repository at this point
Copy the full SHA 96d1e64View commit details -
Using NatureCNN architecture in combined extractor. Increasing img si…
…ze in multi input env. Adding memory reduction in test
Configuration menu - View commit details
-
Copy full SHA for 245f4ab - Browse repository at this point
Copy the full SHA 245f4abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 715fec8 - Browse repository at this point
Copy the full SHA 715fec8View commit details
Commits on Jan 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 4dc1625 - Browse repository at this point
Copy the full SHA 4dc1625View commit details -
Configuration menu - View commit details
-
Copy full SHA for 57c1926 - Browse repository at this point
Copy the full SHA 57c1926View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0fa3650 - Browse repository at this point
Copy the full SHA 0fa3650View commit details -
Configuration menu - View commit details
-
Copy full SHA for 20b217a - Browse repository at this point
Copy the full SHA 20b217aView commit details
Commits on Jan 11, 2021
-
Configuration menu - View commit details
-
Copy full SHA for f6ab0bc - Browse repository at this point
Copy the full SHA f6ab0bcView commit details
Commits on Jan 12, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 6206b36 - Browse repository at this point
Copy the full SHA 6206b36View commit details -
Configuration menu - View commit details
-
Copy full SHA for f064972 - Browse repository at this point
Copy the full SHA f064972View commit details
Commits on Jan 14, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 90d2577 - Browse repository at this point
Copy the full SHA 90d2577View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8f37cb2 - Browse repository at this point
Copy the full SHA 8f37cb2View commit details
Commits on Jan 15, 2021
-
Adding channel control to SimpleMultiObsEnv. Passing check_channels t…
…o CombinedExtractor
Configuration menu - View commit details
-
Copy full SHA for 2984756 - Browse repository at this point
Copy the full SHA 2984756View commit details
Commits on Jan 18, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 324ef43 - Browse repository at this point
Copy the full SHA 324ef43View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2fdcfc6 - Browse repository at this point
Copy the full SHA 2fdcfc6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2bab0a3 - Browse repository at this point
Copy the full SHA 2bab0a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b1ec40d - Browse repository at this point
Copy the full SHA b1ec40dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 12d42e9 - Browse repository at this point
Copy the full SHA 12d42e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5f45044 - Browse repository at this point
Copy the full SHA 5f45044View commit details -
Configuration menu - View commit details
-
Copy full SHA for 510821b - Browse repository at this point
Copy the full SHA 510821bView commit details
Commits on Jan 21, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 0b09976 - Browse repository at this point
Copy the full SHA 0b09976View commit details
Commits on Jan 25, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 8d9183f - Browse repository at this point
Copy the full SHA 8d9183fView commit details
Commits on Feb 1, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 04170df - Browse repository at this point
Copy the full SHA 04170dfView commit details
Commits on Feb 6, 2021
-
Configuration menu - View commit details
-
Copy full SHA for b9c4f05 - Browse repository at this point
Copy the full SHA b9c4f05View commit details
Commits on Feb 18, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 3bb747a - Browse repository at this point
Copy the full SHA 3bb747aView commit details
Commits on Feb 19, 2021
-
Configuration menu - View commit details
-
Copy full SHA for cda8c21 - Browse repository at this point
Copy the full SHA cda8c21View commit details -
Configuration menu - View commit details
-
Copy full SHA for f770217 - Browse repository at this point
Copy the full SHA f770217View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5cbde19 - Browse repository at this point
Copy the full SHA 5cbde19View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4464744 - Browse repository at this point
Copy the full SHA 4464744View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f5553a - Browse repository at this point
Copy the full SHA 1f5553aView commit details -
Configuration menu - View commit details
-
Copy full SHA for dda6990 - Browse repository at this point
Copy the full SHA dda6990View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6716567 - Browse repository at this point
Copy the full SHA 6716567View commit details
Commits on Mar 2, 2021
-
Configuration menu - View commit details
-
Copy full SHA for e756793 - Browse repository at this point
Copy the full SHA e756793View commit details -
Configuration menu - View commit details
-
Copy full SHA for 32b899f - Browse repository at this point
Copy the full SHA 32b899fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6652df3 - Browse repository at this point
Copy the full SHA 6652df3View commit details -
Configuration menu - View commit details
-
Copy full SHA for ec3356e - Browse repository at this point
Copy the full SHA ec3356eView commit details
Commits on Mar 6, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a369bb1 - Browse repository at this point
Copy the full SHA a369bb1View commit details
Commits on Mar 9, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 4f787fa - Browse repository at this point
Copy the full SHA 4f787faView commit details -
Configuration menu - View commit details
-
Copy full SHA for e945ec1 - Browse repository at this point
Copy the full SHA e945ec1View commit details
Commits on Mar 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 12c8be0 - Browse repository at this point
Copy the full SHA 12c8be0View commit details
Commits on Mar 25, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a4851b1 - Browse repository at this point
Copy the full SHA a4851b1View commit details
Commits on Apr 5, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 4138f96 - Browse repository at this point
Copy the full SHA 4138f96View commit details
Commits on Apr 6, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 4f12135 - Browse repository at this point
Copy the full SHA 4f12135View commit details
Commits on Apr 21, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 613a141 - Browse repository at this point
Copy the full SHA 613a141View commit details
Commits on Apr 22, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 0bcfa11 - Browse repository at this point
Copy the full SHA 0bcfa11View commit details
Commits on Apr 27, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 10f4f6b - Browse repository at this point
Copy the full SHA 10f4f6bView commit details
Commits on May 3, 2021
-
* Start refactoring HER * Fixes * Additional fixes * Faster tests * WIP: HER as a custom replay buffer * New replay only version (working with DQN) * Add support for all off-policy algorithms * Fix saving/loading * Remove ObsDictWrapper and add VecNormalize tests with dict * Stable-Baselines3 v1.0 (DLR-RM#354) * Bump version and update doc * Fix name * Apply suggestions from code review Co-authored-by: Adam Gleave <adam@gleave.me> * Update docs/index.rst Co-authored-by: Adam Gleave <adam@gleave.me> * Update wording for RL zoo Co-authored-by: Adam Gleave <adam@gleave.me> * Add gym-pybullet-drones project (DLR-RM#358) * Update projects.rst Added gym-pybullet-drones * Update projects.rst Longer title underline * Update changelog Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org> * Include SuperSuit in projects (DLR-RM#359) * include supersuit * longer title underline * Update changelog.rst * Fix default arguments + add bugbear (DLR-RM#363) * Fix potential bug + add bug bear * Remove unused variables * Minor: version bump * Add code of conduct + update doc (DLR-RM#373) * Add code of conduct * Fix DQN doc example * Update doc (channel-last/first) * Apply suggestions from code review Co-authored-by: Anssi <kaneran21@hotmail.com> * Apply suggestions from code review Co-authored-by: Adam Gleave <adam@gleave.me> Co-authored-by: Anssi <kaneran21@hotmail.com> Co-authored-by: Adam Gleave <adam@gleave.me> * Make installation command compatible with ZSH (DLR-RM#376) * Add quotes * Add Zsh bracket info * Add clarify pip installation line * Make note bold * Add Zsh pip installation note * Add handle timeouts param * Fixes * Fixes (buffer size, extend test) * Fix `max_episode_length` redefinition * Fix potential issue * Add some docs on dict obs * Fix performance bug * Fix slowdown * Add package to install (DLR-RM#378) * Add package to install * Update docs packages installation command Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org> * Fix backward compat + add test * Fix VecEnv detection * Update doc * Fix vec env check * Support for `VecMonitor` for gym3-style environments (DLR-RM#311) * add vectorized monitor * auto format of the code * add documentation and VecExtractDictObs * refactor and add test cases * add test cases and format * avoid circular import and fix doc * fix type * fix type * oops * Update stable_baselines3/common/monitor.py Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org> * Update stable_baselines3/common/monitor.py Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org> * add test cases * update changelog * fix mutable argument * quick fix * Apply suggestions from code review * fix terminal observation for gym3 envs * delete comment * Update doc and bump version * Add warning when already using `Monitor` wrapper * Update vecmonitor tests * Fixes Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org> * Reformat * Fixed loading of ``ent_coef`` for ``SAC`` and ``TQC``, it was not optimized anymore (DLR-RM#392) * Fix ent coef loading bug * Add test * Add comment * Reuse save path * Add test for GAE + rename `RolloutBuffer.dones` for clarification (DLR-RM#375) * Fix return computation + add test for GAE * Rename `last_dones` to `episode_starts` for clarification * Revert advantage * Cleanup test * Rename variable * Clarify return computation * Clarify docs * Add multi-episode rollout test * Reformat Co-authored-by: Anssi "Miffyli" Kanervisto <kaneran21@hotmail.com> * Fixed saving of `A2C` and `PPO` policy when using gSDE (DLR-RM#401) * Improve doc and replay buffer loading * Add support for images * Fix doc * Update Procgen doc * Update changelog * Update docstrings Co-authored-by: Adam Gleave <adam@gleave.me> Co-authored-by: Jacopo Panerati <jacopo.panerati@utoronto.ca> Co-authored-by: Justin Terry <justinkterry@gmail.com> Co-authored-by: Anssi <kaneran21@hotmail.com> Co-authored-by: Tom Dörr <tomdoerr96@gmail.com> Co-authored-by: Tom Dörr <tom.doerr@tum.de> Co-authored-by: Costa Huang <costa.huang@outlook.com>
Configuration menu - View commit details
-
Copy full SHA for 652a6d0 - Browse repository at this point
Copy the full SHA 652a6d0View commit details -
Configuration menu - View commit details
-
Copy full SHA for bcd97cd - Browse repository at this point
Copy the full SHA bcd97cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 89607cf - Browse repository at this point
Copy the full SHA 89607cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 495cf5d - Browse repository at this point
Copy the full SHA 495cf5dView commit details
Commits on May 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 0ea5c61 - Browse repository at this point
Copy the full SHA 0ea5c61View commit details
Commits on May 10, 2021
-
Configuration menu - View commit details
-
Copy full SHA for f8351ab - Browse repository at this point
Copy the full SHA f8351abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 94cb760 - Browse repository at this point
Copy the full SHA 94cb760View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d56c34 - Browse repository at this point
Copy the full SHA 5d56c34View commit details -
Configuration menu - View commit details
-
Copy full SHA for ab75dcd - Browse repository at this point
Copy the full SHA ab75dcdView commit details -
Configuration menu - View commit details
-
Copy full SHA for c30916e - Browse repository at this point
Copy the full SHA c30916eView commit details
Commits on May 11, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 0acea97 - Browse repository at this point
Copy the full SHA 0acea97View commit details -
Configuration menu - View commit details
-
Copy full SHA for d6a59f9 - Browse repository at this point
Copy the full SHA d6a59f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for ce848fb - Browse repository at this point
Copy the full SHA ce848fbView commit details