Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

platform/api/azure: cleanup after Azcopy #219

Merged
merged 1 commit into from
Aug 27, 2021
Merged

Conversation

jepio
Copy link
Member

@jepio jepio commented Aug 27, 2021

Azcopy unfortunately leaves behind log files and plan files in $HOME/.azcopy.
Passing --log-level=NONE removes the log files (but stdout remains informational)
and the plans files are cleaned up after the copy command finishes.

Testing done

$ kola spawn --platform=azure --verbose
2021-08-27T08:24:46Z cli: Started logging at level INFO
2021-08-27T08:24:47Z platform/api/azure: Creating ResourceGroup kola-cluster-image-221f99a0b3
2021-08-27T08:24:48Z platform/api/azure: Creating StorageAccount kolasa41a026327a
2021-08-27T08:25:08Z platform/api/azure: Creating VirtualNetwork kola-vn
2021-08-27T08:25:13Z platform/api/azure: Creating Subnet kola-subnet
2021-08-27T08:25:16Z platform/machine/azure: Copying blob
INFO: Scanning...
INFO: Failed to create one or more destination container(s). Your transfers may still succeed if the container already exists.
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

Job 5b2f8415-f279-e64e-53e6-2498e41e59c4 has started
Log file is located at: /home/jeremi/.azcopy/5b2f8415-f279-e64e-53e6-2498e41e59c4.log
....
$ ls -laR ~/.azcopy/
/home/jeremi/.azcopy/:
total 12
drwxr-xr-x  3 jeremi jeremi 4096 Aug 27 10:25 .
drwxr-xr-x 30 jeremi jeremi 4096 Aug 27 10:31 ..
drwxr-xr-x  2 jeremi jeremi 4096 Aug 27 10:25 plans

/home/jeremi/.azcopy/plans:
total 8
drwxr-xr-x 2 jeremi jeremi 4096 Aug 27 10:25 .
drwxr-xr-x 3 jeremi jeremi 4096 Aug 27 10:25 ..

@jepio jepio requested a review from a team August 27, 2021 08:32
Azcopy unfortunately leaves behind log files and plan files in $HOME/.azcopy.
Passing `--log-level=NONE` removes the log files (but stdout remains informational)
and the plans files are cleaned up after the copy command finishes.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
@jepio jepio merged commit 4f07f3e into flatcar-master Aug 27, 2021
@jepio jepio deleted the jepio/azcopy-cleanup branch August 27, 2021 11:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants