Test Case 5: Bundle that references accumulating collections by LID

[jordanpadams]

No description provided.

[jordanpadams]

Example data submitted: https://pds.nasa.gov/data/pds4/manifests/insight_documents_v2.0_20200601_sip_v1.0.xml
https://pds.nasa.gov/data/pds4/manifests/insight_documents_v2.0_20200602_sip_v1.0.xml

[jordanpadams]

After a few iterations due to the manual nature of the bundles, they were successfully validated upon initial ingest of bundle and collections:

Release 1: https://pds.nasa.gov/data/pds4/manifests/insight_documents_v2.0_20200601_sip_v1.0.xml
SIP LIDVID: urn:nasa:pds:system_bundle:product_sip_deep_archive:insight_documents_v2.0_20200601::1.0

· SIP and bundle successfully validated
· 5 primary collections found
o urn:nasa:pds:insight_documents:document_mission::1.1
o urn:nasa:pds:insight_documents:document_hp3rad::5.0
o urn:nasa:pds:insight_documents:document_ida::3.0
o urn:nasa:pds:insight_documents:document_rise::4.0
o urn:nasa:pds:insight_documents:document_seis::5.0
· All 5 collections were successfully validated
· SIP parameters were sent to the Ingest system

Release 2: https://pds.nasa.gov/data/pds4/manifests/insight_documents_v2.0_20200602_sip_v1.0.xml
SIP LIDVID: urn:nasa:pds:system_bundle:product_sip_deep_archive:insight_documents_v2.0_20200602::4.0

· SIP and bundle successfully validated
· 5 primary collections found
o urn:nasa:pds:insight_documents:document_mission::1.1
o urn:nasa:pds:insight_documents:document_hp3rad::5.0
o urn:nasa:pds:insight_documents:document_ida::3.0
o urn:nasa:pds:insight_documents:document_rise::5.0
o urn:nasa:pds:insight_documents:document_seis::5.0
· All 5 collections were successfully validated
· SIP parameters were sent to the Ingest system

[jordanpadams]

From Pat M., the test was successful:

All,

Those last two Geosciences insight SIPs from engineering that test accumulating data have both ingested successfully. The NSSDCA ingest system performed as it should.

SIP LIDVID: urn:nasa:pds:system_bundle:product_sip_deep_archive:insight_documents_v2.0_20200601::2.0 (SIP #373)
24 products: 1 bundle, 5 collections, 18 basic products

SIP LIDVID: urn:nasa:pds:system_bundle:product_sip_deep_archive:insight_documents_v2.0_20200602::4.0 (SIP #402)
25 products: 1 bundle, 5 collections, 19 basic products

This was the scenario was the one we originally expected. A new product was added to one of the collections. The collection product was replaced by a new collection product with a higher VID.

The ingest system did what it was supposed to do: no product was ingested twice. The order in which the SIPs are processed has no effect on the end result.

I’ll provide Larry with the information to retrieve the products.

           Pat

[jordanpadams]

Re-ran with latest pds-deep-archive:

$ pds-deep-archive -s PDS_GEO -b  https://pds.nasa.gov/data/pds4/test-bundles/ /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml

and with

$ pds-deep-archive -s PDS_GEO -b  https://pds.nasa.gov/data/pds4/test-bundles/ /data/local/starbase/data/pds4/test-bundles/urn-nasa-pds-insight_documents/bundle_insight_documents.xml --include-all-collections

as expected, the second run included 2 additional files from the first

[jordanpadams]

See #32 (comment)