Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding hooks for running on-prem automated WE2E tests. #676

Merged
merged 1 commit into from
Feb 15, 2022
Merged

Adding hooks for running on-prem automated WE2E tests. #676

merged 1 commit into from
Feb 15, 2022

Conversation

christinaholtNOAA
Copy link
Contributor

DESCRIPTION OF CHANGES:

Adds the hooks necessary to interact with the on-prem automated testing framework developed at NOAA-GSL. The framework runs regularly via cron on Jet and Hera (can be deployed to other machines by those with accounts/resources) and checks all open PRs for labels like ci-jet-intel-WE and ci-hera-intel-WE before 1) building the code, and 2) running WE2E tests for either SRW and regional_workflow.

The changes here add the following:

  • A script to setup the WE2E tests per machine, and to be consistent with the SRW build test directory structure.
  • Adds configurable option for installation location since the build test puts the bin directory in a slightly different location than the assumed default.

Once implemented, the existing Jet and Hera framework will support testing PRs to develop in either repositories. We can share the framework code so that these automated tests may be run on other supported platforms.

Outstanding work includes adding additional tests to the machine suite files.

TESTS CONDUCTED:

We have tested this script as a part of our test framework on Jet and Hera using the test included here in the machine suites files.

CONTRIBUTORS (optional):

@venitahagerty @robgonzalezpita

@mkavulich mkavulich added ci-hera-intel-WE Kicks off automated workflow test on hera with intel ci-jet-intel-WE Kicks off automated workflow test on jet with intel labels Feb 9, 2022
@venitahagerty
Copy link
Collaborator

Machine: hera
Compiler: intel
Job: WE
Repo location: /scratch2/BMC/zrtrr/rrfs_ci/autoci/pr/843090532/20220210134601/ufs-srweather-app
Build was Successful
Rocoto jobs started
Done: 0 of 1
Long term tracking will be done
If test failed, please make changes and add the following label back:
ci-hera-intel-WE

@venitahagerty
Copy link
Collaborator

Experiment Succeeded on hera: grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
2022-02-10 14:26:09 +0000 :: hfe05 :: This cycle is complete: Success

@venitahagerty
Copy link
Collaborator

Machine: jet
Compiler: intel
Job: WE
Repo location: /lfs1/BMC/nrtrr/rrfs_ci/autoci/pr/843090532/20220210152109/ufs-srweather-app
Build was Successful
Rocoto jobs started
Done: 0 of 1
Long term tracking will be done
If test failed, please make changes and add the following label back:
ci-jet-intel-WE

@venitahagerty
Copy link
Collaborator

Experiment Succeeded on jet: grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
2022-02-10 16:30:10 +0000 :: fe7 :: This cycle is complete: Success

@JeffBeck-NOAA JeffBeck-NOAA merged commit e5d5c38 into ufs-community:develop Feb 15, 2022
@mkavulich mkavulich mentioned this pull request Feb 16, 2022
Merged
mkavulich pushed a commit to ufs-community/ufs-srweather-app that referenced this pull request Feb 16, 2022
@christinaholtNOAA
Update hash for regional_workflow. (#213)
a3950b4 
## DESCRIPTION OF CHANGES: 
Updates the hash to the regional_workflow to include the script necessary for running automated WE2E tests.

## TESTS CONDUCTED: 
Tests were conducted with the top of this branch with the acceptance of the regional_workflow PR (ufs-community/regional_workflow#676).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JeffBeck-NOAA JeffBeck-NOAA JeffBeck-NOAA approved these changes

@BenjaminBlake-NOAA BenjaminBlake-NOAA Awaiting requested review from BenjaminBlake-NOAA BenjaminBlake-NOAA is a code owner

@gsketefian gsketefian Awaiting requested review from gsketefian gsketefian is a code owner

@mkavulich mkavulich Awaiting requested review from mkavulich mkavulich is a code owner

Assignees
No one assigned
Labels
ci-hera-intel-WE Kicks off automated workflow test on hera with intel ci-jet-intel-WE Kicks off automated workflow test on jet with intel
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@christinaholtNOAA @venitahagerty @JeffBeck-NOAA @mkavulich