You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When running deep archive on this EPOXI bundle (pds-gamma:/data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0) all the data files under hartley2_photometry/data/ are missing.
To Reproduce
Steps to reproduce the behavior:
Download the data from above
Run pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ pds4-epoxi_mri-v1.0/bundle.xml
Expected behavior
the SIP and AIP should contain all the product references in pds4-epoxi_mri-v1.0/hartley2_photometry/inventory.csv
Note some of the weirdness with this bundle:
There is an overview.xml in the same directory as collection.xml so we need to make sure that file is included.
There are data and document sub-directories that both contain data from the inventory.csv (this is horrendous archiving, but it is what it is)
pds4-epoxi_mri-v1.0/hartley2_photometry/document/epoxi_photometry_v5.[xml|pdf] should actually not be included in the SIP/AIP because its LID does not match the LID in the inventory file
jordanpadams
changed the title
Software does not include various data files from EPOXI bundle
Software appears to be excluding all the products associated with the collections
Jun 19, 2020
Update: It appears the software is only outputting bundles/collections and not any of the associated products. It appears all the files are getting written to the database, just not the AIP/SIP.
Note to self (i.e., @nutjob4life): we parse for "P" lines in any <file_name> so long as the root element is a <Product_Collection>. We don't have to key off of .tab files like we currently are doing.
Describe the bug
When running deep archive on this EPOXI bundle (
pds-gamma:/data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0
) all the data files underhartley2_photometry/data/
are missing.To Reproduce
Steps to reproduce the behavior:
pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ pds4-epoxi_mri-v1.0/bundle.xml
Expected behavior
the SIP and AIP should contain all the product references in
pds4-epoxi_mri-v1.0/hartley2_photometry/inventory.csv
Note some of the weirdness with this bundle:
overview.xml
in the same directory ascollection.xml
so we need to make sure that file is included.data
anddocument
sub-directories that both contain data from theinventory.csv
(this is horrendous archiving, but it is what it is)pds4-epoxi_mri-v1.0/hartley2_photometry/document/epoxi_photometry_v5.[xml|pdf]
should actually not be included in the SIP/AIP because its LID does not match the LID in the inventory fileRefs #32
The text was updated successfully, but these errors were encountered: