You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If the goal is to keep the cache to speed things up, my suggestion would be to add a couple checks in the "Install dependencies" step in the workflow:
Check the version of torch before installing requirements.txt, save in Bash variable.
Install requirements.txt
Check the version of torch after, save in Bash variable.
If torch version before != version after, then uninstall Horovod.
Install requirements-extra.txt.
This way, we should be able to leverage the cache to speed things up when nothing changes, without running into incompatibilities when the torch version is upgraded.
@tgaddair PR would be great!
I am a bit suspicions as you mentioned that the cache is not loaded properly so thinking about opening an issue with https://github.com/actions/cache
🐛 Bug
there is some issue with GH action and caching as it is randomly failing with using Horovod
To Reproduce
#1709 (comment)
The text was updated successfully, but these errors were encountered: