Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update apiv2 db ingestion to support new s3 schema #324

Merged
merged 33 commits into from
Oct 21, 2024

Conversation

jgadling
Copy link
Contributor

This PR is currently in a DRAFT state because I haven't updated the tests to reflect the latest changes, however the importer should be complete and working.

Some changes to note:

  • Annotation importers were refactored to use the new importer base classes because that made it easier to update them to support ingesting a single annotation across multiple voxel spacings
  • The Tomogram importer was refactored as well, just to help this migration along.

I've update the test data to look more like real-world data, with zarr files and other extras, basically because it made running the s3 conversion script on our existing test data easier. These files are a little bit out of date as well since they still reflect old file path formats, but I'll update them soon.

@jgadling jgadling merged commit 02441de into main Oct 21, 2024
8 checks passed
@jgadling jgadling deleted the jgadling/fix-import-paths branch October 21, 2024 19:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant