Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Standardize static data across Tier-1 platforms; fix and improve IC and LBC data retrieval #744

Merged
merged 36 commits into from
May 3, 2022
Merged

Standardize static data across Tier-1 platforms; fix and improve IC and LBC data retrieval #744

merged 36 commits into from
May 3, 2022

Commits on Apr 25, 2022

  1. Start reorganization of static data per ufs-community/ufs-srweather-a… 

    …pp#231
    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    c499652 View commit details
    Browse the repository at this point in the history

  2. NOMADS wget commands now will only retry once after failure to speed … 

    …up testing when it fails
    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    bd6e44d View commit details
    Browse the repository at this point in the history

  3. Address 2 main issues for cycling failures.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    d33ad19 View commit details
    Browse the repository at this point in the history

  4. Source the machine file before config.sh 

    With the addition of a configurable data stores variable that is
machine-dependent, we must load the machine file configs first so that
we can override the values for the specific configuration.
    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    1a08664 View commit details
    Browse the repository at this point in the history

  5. Adding data stores to machine files. 

    Some of these are guesses!
    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    2b99615 View commit details
    Browse the repository at this point in the history

  6. Make data stores configurable.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    8194cff View commit details
    Browse the repository at this point in the history

  7. Ensure that the tests use only data on disk.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    4dfdd87 View commit details
    Browse the repository at this point in the history

  8. Revert "Source the machine file before config.sh" 

    This reverts commit f91d0bf.
    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    74e3726 View commit details
    Browse the repository at this point in the history

  9. Christina updates

    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    8f77203 View commit details
    Browse the repository at this point in the history

  10. Remove requirement for sfc files with LBCS.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    1d5b021 View commit details
    Browse the repository at this point in the history

  11. Fix how templates of paths are handled.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    3dcdde3 View commit details
    Browse the repository at this point in the history

  12. Explicitly set name of RAP/HRRR files to match disk.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    6622ded View commit details
    Browse the repository at this point in the history

  13. Set filenames for RAP/HRRR

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    2b295d5 View commit details
    Browse the repository at this point in the history

  14. Fix typo

    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    d6e5a80 View commit details
    Browse the repository at this point in the history

  15. Specify location of pregen data for Cheyenne

    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    be8e189 View commit details
    Browse the repository at this point in the history

  16. Staged static directory

    @mkavulich
    WYH@MBP authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    6fd909e View commit details
    Browse the repository at this point in the history

  17. Standarized static files following PR ufs-community#744 for Odin and … 

    …Stampede
    @ywangwof @mkavulich
    ywangwof authored and mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    f6c23ee View commit details
    Browse the repository at this point in the history

  18. Missed one update for Jet

    @mkavulich
    mkavulich committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    04c53c2 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. Add config override for data stores on all platforms.

    @christinaholtNOAA
    christinaholtNOAA committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    b2d18df View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2022

  1. updates for gaea

    @mark-a-potts
    mark-a-potts committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    b3b02ee View commit details
    Browse the repository at this point in the history

  2. Remove capture_output for WCOSS compatibility.

    @christinaholtNOAA
    christinaholtNOAA committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    3fd79b0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/standardize_static_data' of https://github.com/… 

    …mkavulich/regional_workflow into feature/standardize_static_data
    @mark-a-potts
    mark-a-potts committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    1715e27 View commit details
    Browse the repository at this point in the history

  4. Update COMIN location on Hera to match other platforms

    @mkavulich
    mkavulich committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    2b69690 View commit details
    Browse the repository at this point in the history

  5. Fix Issue ufs-community#700.

    @christinaholtNOAA @mkavulich
    christinaholtNOAA authored and mkavulich committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    feacafe View commit details
    Browse the repository at this point in the history

  6. Updated noaacloud.sh

    @mark-a-potts
    mark-a-potts committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    beb1c1c View commit details
    Browse the repository at this point in the history

  7. Merge branch 'feature/standardize_static_data' of https://github.com/… 

    …mkavulich/regional_workflow into feature/standardize_static_data
    @mark-a-potts
    mark-a-potts committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    5265c26 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. Updates to standardize data locations on wcoss_dell_p3

    @mkavulich
    mkavulich committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    0d17d8b View commit details
    Browse the repository at this point in the history

  2. A few wcoss changes requested by Chan-Hoo

    @mkavulich
    mkavulich committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    c5bebe7 View commit details
    Browse the repository at this point in the history

  3. getting conda working correctly

    @mark-a-potts
    mark-a-potts committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    513cf20 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/standardize_static_data' of https://github.com/… 

    …mkavulich/regional_workflow into feature/standardize_static_data
    @mark-a-potts
    mark-a-potts committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    e5bf146 View commit details
    Browse the repository at this point in the history

  5. replaced srun with mpiexec due to changes in image

    @mark-a-potts
    mark-a-potts committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    9a3315e View commit details
    Browse the repository at this point in the history

Commits on May 3, 2022

  1. Merge remote-tracking branch 'upstream/develop' into feature/standard… 

    …ize_static_data
    @mkavulich
    mkavulich committed May 3, 2022
    Configuration menu
    Copy the full SHA
    0279902 View commit details
    Browse the repository at this point in the history

  2. Correct location of Orion static data

    @mkavulich
    mkavulich committed May 3, 2022
    Configuration menu
    Copy the full SHA
    cec308a View commit details
    Browse the repository at this point in the history

  3. Move DOMAIN_PREGEN_BASEDIR out of NCO section since it is no longer N… 

    …CO-specific
    @mkavulich
    mkavulich committed May 3, 2022
    Configuration menu
    Copy the full SHA
    b4a7a18 View commit details
    Browse the repository at this point in the history

  4. Fix default location for input model files on Cheyenne

    @mkavulich
    mkavulich committed May 3, 2022
    Configuration menu
    Copy the full SHA
    59f0d60 View commit details
    Browse the repository at this point in the history

  5. Revert "Fix default location for input model files on Cheyenne" 

    This reverts commit 59f0d60.
    @mkavulich
    mkavulich committed May 3, 2022
    Configuration menu
    Copy the full SHA
    854d3f2 View commit details
    Browse the repository at this point in the history