Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update static tar files for v2 release #716

Closed
jwolff-ncar opened this issue Mar 25, 2022 · 7 comments
Closed

Update static tar files for v2 release #716

jwolff-ncar opened this issue Mar 25, 2022 · 7 comments

Comments

@jwolff-ncar
Copy link
Contributor

Description

Need to update tar files for the latest release. (See version 1.0 files for what was included last time)

Solution

Create and stage these files:
https://ftp.emc.ncep.noaa.gov/EIB/UFS/SRW/v2p0/fix/>`

https://ufs-data.s3.amazonaws.com/public_release/ufs-srweather-app-v2.0.0/fix/fix_files.tar.gz

https://ftp.emc.ncep.noaa.gov/EIB/UFS/SRW/v2p0/simple_test_case/gst_model_data.tar.gz

https://ufs-data.s3.amazonaws.com/public_release/ufs-srweather-app-v2.0.0/ic/gst_model_data.tar.gz

@jwolff-ncar
Copy link
Contributor Author

(I am not sure who will be working on this so for now tagged @mark-a-potts to help determine who might be able to help with this!)

@jwolff-ncar jwolff-ncar changed the title Update static tar files on AWS Update static tar files for v2 release Mar 30, 2022
@mkavulich
Copy link
Collaborator

There are a few issues/PRs that need to be resolved before this data should be staged for release:

@CSyl
Copy link

CSyl commented Apr 6, 2022

All,
FYI: Once the locations of the data required for SRW application has been finalized/ standardized, I will be sourcing the SRW data from those locations and uploading them from on-prem to a Big Data Program (BDP) soon-to-be established cloud data storage bucket (designated solely for the SRW application).
Please keep me posted on the final standardized source locations for the data required for the SRW application. Thank you!

@laurenfrederick
Copy link

Pet the SRW Release meeting, @CSyl will be staging the tar files to the BDP bucket in AWS and no data will be available for download via FTP.

@GeorgeGayno-NOAA
Copy link
Contributor

There are new static files required for UFS_UTILS. Contact me or @JeffBeck-NOAA more information.

@mkavulich
Copy link
Collaborator

For future reference, static data for all WE2E tests (as of today) can be found on Hera:

/scratch2/BMC/det/UFS_SRW_app/develop/fix.tar
/scratch2/BMC/det/UFS_SRW_app/develop/input_model_data.tar

The untarred input_model_data directory contains a README file with information about the data and directory structure.

@GeorgeGayno-NOAA @JeffBeck-NOAA The fix.tar file was created from the original location (/scratch1/NCEPDEV/global/glopara/fix/) on April 21, so it should have all the new fix files necessary. I reviewed the files listed in the UFS_UTILS issue and ensured that they are all available in the tar files.

@JeffBeck-NOAA
Copy link
Collaborator

Thank you for confirming, @mkavulich!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants