Alignment File & CTF

[junxini]

Context: The current tomograms provided in the portal may not fit the needs of every user. We need to integrate and surface alignment file and CTF information in the metadata to allow users to create their own tomograms using the tilt series provided. See more on the context in one pager here

Backend Spec:

https://docs.google.com/document/d/1InjJKrx78Sv44QguMXR0p1o9Y34oPnMOY9J3aj375ks/edit?usp=sharing

Frontend:

P0s

• Alignment file & CTF fields #778
• Update queries to use new data models

Backend:

P0:

• Define ingestion workflow for new directory structure for new schema #1017
• Finalize the new database schema #896
• Update ingestion config validation for ctf and alignment entities #997
• Adding reference spec to config #1148
• Update S3 Ingestion workflow to support Alignment #898
• Update S3 Ingestion workflow to add Alignment relationships #1053
• Update database ingestion workflow for existing v1 api #897
• Update database ingestion workflow for v2 api #1090
• Migrate existing ingested data to new folder structure #899
• Ingest standardized tomogram to production #1171
• Handle different alignment converters #1208

P1

• Update the ingestion configs for Frames #1054
• Update S3 Ingestion workflow to support Frames #1055
• Update S3 Ingestion workflow to support CTF #1056
• Refactor ImporterFactory for multiple files into a finder #1142
• Update client to support multiple tomogram features #1091

Documentation:

• Update documentation related to alignment/ctf/mutliple tomograms #901