Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add /relay-data mount to transfer container #729

Merged
merged 2 commits into from
Feb 9, 2023

Conversation

skunert
Copy link
Contributor

@skunert skunert commented Feb 9, 2023

In paritytech/cumulus#1909 we are trying to add a zombienet test for parachain warp sync, which contains parachain snapshots.

CI fails on this test: https://gitlab.parity.io/parity/mirrors/cumulus/-/jobs/2367758

My knowledge about our CI/kubernetes setup is pretty limited. It looks like we are unable to extract the relay-data folder from db.tgz. I think the solution is to add a /relay-data mount to the transfer container.

Error:  	 Error: Command failed with exit code 1: kubectl --kubeconfig /home/nonroot/.kube/config --namespace zombie-ebc43732f106b962c56454c20f46b914 exec dave-1 -c transfer-files-container -- ash -c mkdir -p /data/ && wget https://storage.googleapis.com/zombienet-db-snaps/cumulus/0007-full_node_warp_sync/parachain-587c1ed24ddd7de05c237cf7c158fff53b8f5b26.tgz -O /data/db.tgz && cd / && tar -xzvf /data/db.tgz
I0208 16:09:04.671310    1366 log.go:198] (0xc0000fc000) (0xc000656a00) Create stream
I0208 16:09:04.671526    1366 log.go:198] (0xc0000fc000) (0xc000656a00) Stream added, broadcasting: 1
I0208 16:09:04.679650    1366 log.go:198] (0xc0000fc000) Reply frame received for 1
I0208 16:09:04.679724    1366 log.go:198] (0xc0000fc000) (0xc000656000) Create stream
I0208 16:09:04.679740    1366 log.go:198] (0xc0000fc000) (0xc000656000) Stream added, broadcasting: 3
I0208 16:09:04.684539    1366 log.go:198] (0xc0000fc000) Reply frame received for 3
I0208 16:09:04.684611    1366 log.go:198] (0xc0000fc000) (0xc000204000) Create stream
I0208 16:09:04.684628    1366 log.go:198] (0xc0000fc000) (0xc000204000) Stream added, broadcasting: 5
I0208 16:09:04.6[884](https://gitlab.parity.io/parity/mirrors/cumulus/-/jobs/2367758#L884)89    1366 log.go:198] (0xc0000fc000) Reply frame received for 5
I0208 16:09:04.727763    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:04.727812    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:04.727843    1366 log.go:198] (0xc000204000) (5) Data frame sent
Connecting to storage.googleapis.com (142.250.185.144:443)
I0208 16:09:04.866445    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:04.866497    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:04.866511    1366 log.go:198] (0xc000204000) (5) Data frame sent
saving to '/data/db.tgz'
I0208 16:09:05.110526    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:05.110579    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:05.110594    1366 log.go:198] (0xc000204000) (5) Data frame sent
db.tgz               100% |********************************| 39.5M  0:00:00 ETA
'/data/db.tgz' saved
I0208 16:09:05.110861    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.110897    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.110926    1366 log.go:198] (0xc000656000) (3) Data frame sent
I0208 16:09:05.241940    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.242006    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.242037    1366 log.go:198] (0xc000656000) (3) Data frame sent
I0208 16:09:05.262202    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.262283    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.262298    1366 log.go:198] (0xc000656000) (3) Data frame sent
I0208 16:09:05.262348    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:05.262434    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:05.262461    1366 log.go:198] (0xc000204000) (5) Data frame sent
I0208 16:09:05.262475    1366 log.go:198] (0xc0000fc000) Data frame received for 5
tar: can't make dir relay-data: Permission denied
I0208 16:09:05.262504    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.262555    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.262569    1366 log.go:198] (0xc000656000) (3) Data frame sent
I0208 16:09:05.262590    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:05.262603    1366 log.go:198] (0xc000204000) (5) Data frame sent
I0208 16:09:05.262613    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:05.262623    1366 log.go:198] (0xc000204000) (5) Data frame handling
tar: can't create directory 'relay-data': Permission denied
tar: can't make dir relay-data/chains: No such file or directory
tar: can't create directory 'relay-data/': Permission denied
tar: can't make dir relay-data/: Permission denied
tar: can't create directory 'relay-data/': Permission denied
tar: can't make dir relay-data/: Permission denied
tar: can't create directory 'relay-data/': Permission denied
tar: can't make dir relay-data/: Permission denied
I0208 16:09:05.262651    1366 log.go:198] (0xc000204000) (5) Data frame sent
I0208 16:09:05.262661    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:05.262672    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:05.262681    1366 log.go:198] (0xc000204000) (5) Data frame sent
tar: can't create directory 'relay-data/': Permission denied
tar: can't open 'relay-data/': Is a directory
I0208 16:09:05.262947    1366 log.go:198] (0xc0000fc000) Data frame received for 5
I0208 16:09:05.263151    1366 log.go:198] (0xc000204000) (5) Data frame handling
I0208 16:09:05.263205    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.263219    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.263229    1366 log.go:198] (0xc000656000) (3) Data frame sent
I0208 16:09:05.263271    1366 log.go:198] (0xc0000fc000) Data frame received for 3
I0208 16:09:05.263307    1366 log.go:198] (0xc000656000) (3) Data frame handling
I0208 16:09:05.264762    1366 log.go:198] (0xc0000fc000) Data frame received for 1
I0208 16:09:05.264796    1366 log.go:198] (0xc000656a00) (1) Data frame handling
I0208 16:09:05.264809    1366 log.go:198] (0xc000656a00) (1) Data frame sent
I0208 16:09:05.264[886](https://gitlab.parity.io/parity/mirrors/cumulus/-/jobs/2367758#L886)    1366 log.go:198] (0xc0000fc000) (0xc000656a00) Stream removed, broadcasting: 1
I0208 16:09:05.264[944](https://gitlab.parity.io/parity/mirrors/cumulus/-/jobs/2367758#L944)    1366 log.go:198] (0xc0000fc000) Go away received
I0208 16:09:05.265413    1366 log.go:198] (0xc0000fc000) (0xc000656a00) Stream removed, broadcasting: 1
I0208 16:09:05.265441    1366 log.go:198] (0xc0000fc000) (0xc000656000) Stream removed, broadcasting: 3
I0208 16:09:05.265453    1366 log.go:198] (0xc0000fc000) (0xc000204000) Stream removed, broadcasting: 5
command terminated with exit code 1

Copy link
Collaborator

@pepoviola pepoviola left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!!

@pepoviola pepoviola merged commit c0c7662 into paritytech:main Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants