[Bug]: Cannot enjoy due to error Cannot convert space of type Discrete(7). Please upgrade your code to gymnasium.

[notshashwat]

🐛 Bug

I am trying to get the following code to work on kaggle. I have already trained the agent which worked fine but when i run the following :

$ python -m rl_zoo3.enjoy --algo ppo --env MiniGrid-Unlock-v0

I have done the following installations on kaggle:

!git clone --recursive https://github.com/DLR-RM/rl-baselines3-zoo
!pip install -e rl-baselines3-zoo/
!pip install minigrid
!pip install shimmy>=0.2.1
!pip install stable_baselines3

To Reproduce

python -m rl_zoo3.enjoy --algo ppo --env MiniGrid-Unlock-v0

Relevant log output / Error message

/opt/conda/lib/python3.10/site-packages/gym/envs/registration.py:307: DeprecationWarning: The package name gym_minigrid has been deprecated in favor of minigrid. Please uninstall gym_minigrid and install minigrid with `pip install minigrid`. Future releases will be maintained under the new package name minigrid.
  fn()
Loading latest experiment, id=1
Loading rl-trained-agents/ppo/MiniGrid-Unlock-v0_1/MiniGrid-Unlock-v0.zip
/opt/conda/lib/python3.10/site-packages/stable_baselines3/common/vec_env/patch_gym.py:49: UserWarning: You provided an OpenAI Gym environment. We strongly recommend transitioning to Gymnasium environments. Stable-Baselines3 is automatically wrapping your environments in a compatibility layer, which could potentially cause issues.
  warnings.warn(
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/conda/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/kaggle/working/rl-baselines3-zoo/rl_zoo3/enjoy.py", line 276, in <module>
    enjoy()
  File "/kaggle/working/rl-baselines3-zoo/rl_zoo3/enjoy.py", line 156, in enjoy
    env = create_test_env(
  File "/kaggle/working/rl-baselines3-zoo/rl_zoo3/utils.py", line 241, in create_test_env
    env = make_vec_env(
  File "/opt/conda/lib/python3.10/site-packages/stable_baselines3/common/env_util.py", line 125, in make_vec_env
    vec_env = vec_env_cls([make_env(i + start_index) for i in range(n_envs)], **vec_env_kwargs)
  File "/opt/conda/lib/python3.10/site-packages/stable_baselines3/common/vec_env/dummy_vec_env.py", line 30, in __init__
    self.envs = [_patch_env(fn()) for fn in env_fns]
  File "/opt/conda/lib/python3.10/site-packages/stable_baselines3/common/vec_env/dummy_vec_env.py", line 30, in <listcomp>
    self.envs = [_patch_env(fn()) for fn in env_fns]
  File "/opt/conda/lib/python3.10/site-packages/stable_baselines3/common/vec_env/patch_gym.py", line 58, in _patch_env
    return shimmy.GymV26CompatibilityV0(env=env)
  File "/opt/conda/lib/python3.10/site-packages/shimmy/openai_gym_compatibility.py", line 81, in __init__
    self.action_space = _convert_space(self.gym_env.action_space)
  File "/opt/conda/lib/python3.10/site-packages/shimmy/openai_gym_compatibility.py", line 333, in _convert_space
    raise NotImplementedError(
NotImplementedError: Cannot convert space of type Discrete(7). Please upgrade your code to gymnasium.

[araffin]

Hello,
the error is pretty explicit, you need to upgrade the env code to gymnasium, the RL Zoo doesn't support gym 0.21 since 2.1.0.

EDIT: the error comes from gymnasium, not SB3/RL Zoo