You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To support the multiple tomograms, there needs to be restructuring of how the data is store. While it is easy for us to do this using the ingestion process for new data, it will be expensive to re ingest all the information. So, for the data that already exists, we should migrate them using a scripting. This will not apply to metadata json files, as they are cheaper to create.
Definition of Done
All the existing datasets are updated to follow the new structure.
Tasks
Move the data the would remain the same, but would be renamed or relocated.
Re-ingest all the relevant metadata.
Note
This should not be synced to production until the work for #897 is complete.
Motivation
To support the multiple tomograms, there needs to be restructuring of how the data is store. While it is easy for us to do this using the ingestion process for new data, it will be expensive to re ingest all the information. So, for the data that already exists, we should migrate them using a scripting. This will not apply to metadata json files, as they are cheaper to create.
Definition of Done
All the existing datasets are updated to follow the new structure.
Tasks
Note
This should not be synced to production until the work for #897 is complete.
Relevant Resources
New directory structure: https://docs.google.com/document/d/1InjJKrx78Sv44QguMXR0p1o9Y34oPnMOY9J3aj375ks/edit#bookmark=id.oj7rrczgok3c
The text was updated successfully, but these errors were encountered: