You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This might be dangerous because the way health_azure checks whether is_local_rank_zero might be compatible with Lightning but not with other frameworks, and the files are unexpectedly missing after being "downloaded". This is especially problematic when validate_checksum is True, because one would expect that things are double-checked after downloading.
A minimally-invasive change would be logging a warning before returning None. It might also be nice to propagate the paths of the downloaded files up to other functions that call this one. For example, maybe _download_files_from_run and download_files_from_run_id should return the paths of all downloaded files.
The text was updated successfully, but these errors were encountered:
fepegar
changed the title
_download_file_from_run silently does nothing if is_local_rank_zero() returns True
_download_file_from_run silently does nothing if is_local_rank_zero() returns FalseApr 16, 2024
fepegar
changed the title
_download_file_from_run silently does nothing if is_local_rank_zero() returns False_download_file_from_run silently does nothing if is_local_rank_zero() returns FalseApr 16, 2024
This might be dangerous because the way health_azure checks whether
is_local_rank_zero
might be compatible with Lightning but not with other frameworks, and the files are unexpectedly missing after being "downloaded". This is especially problematic whenvalidate_checksum
isTrue
, because one would expect that things are double-checked after downloading.hi-ml/hi-ml-azure/src/health_azure/utils.py
Lines 1176 to 1195 in c606808
A minimally-invasive change would be logging a warning before returning
None
. It might also be nice to propagate the paths of the downloaded files up to other functions that call this one. For example, maybe_download_files_from_run
anddownload_files_from_run_id
should return the paths of all downloaded files.The text was updated successfully, but these errors were encountered: