Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hotfix to disable STALLED in CI as an error #2523

Merged
merged 2 commits into from
Apr 23, 2024

Conversation

TerrenceMcGuinness-NOAA
Copy link
Collaborator

Description

This hotfix to the last CI updates disables the STALLED feature by not flagging it as an error until a more succinct algorithm is determined (i.e. the STALLED state will be at par with RUNNING).

A second minor bug is in the event that no error log is produced when a Case fails, the error of the fail is still reported to the general user in GitHub. (Jenkins enabled users can always see the full comprehensive state of system by following the links at the bottom of the PR).

Type of change

  • Bug fix (fixes something broken)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO

How has this been tested?

Being this is a CI update the test is running the CI on itself.

… with RUNNING) and added message to user on Case fail when there is also not an error log present (bug had no message out in that case)
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI/CD Issue related to CI/CD labels Apr 23, 2024
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title Hot fix to disable STALLED as an error (only reports as status at par… Hot fix to disable STALLED as an error Apr 23, 2024
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title Hot fix to disable STALLED as an error Hotfix to disable STALLED in CI as an error Apr 23, 2024
@emcbot emcbot added CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera and removed CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera labels Apr 23, 2024
Copy link
Contributor

@aerorahul aerorahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good.

@aerorahul aerorahul merged commit 3d0f643 into NOAA-EMC:develop Apr 23, 2024
1 of 3 checks passed
@aerorahul aerorahul deleted the hotfix_nostall branch April 23, 2024 15:37
@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Apr 23, 2024
@emcbot
Copy link

emcbot commented Apr 23, 2024

Experiment C96_atmaerosnowDA FAILED on Hera with error logs:

/scratch1/NCEPDEV/global/CI/2523/RUNTESTS/COMROOT/C96_atmaerosnowDA_dcdc616e/logs/2021122012/gdasfcst.log

Follow link here to view the contents of the above file(s): (link)

@emcbot emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Apr 23, 2024
@emcbot
Copy link

emcbot commented Apr 23, 2024

Experiment C96_atmaerosnowDA FAILED on Hera
in/scratch1/NCEPDEV/global/CI/2523/RUNTESTS/C96_atmaerosnowDA_dcdc616e

danholdaway added a commit to danholdaway/global-workflow that referenced this pull request Apr 23, 2024
* upstream/develop:
  Add CCPP suite and FASTER option to UFS build (NOAA-EMC#2521)
  New "atmanlfv3inc" Rocoto job (NOAA-EMC#2420)
  Hotfix to disable STALLED in CI as an error (NOAA-EMC#2523)
  Add restart on failure capability for the forecast executable (NOAA-EMC#2510)
  Update parm/transfer list files to match vetted GFSv16 set (NOAA-EMC#2517)
  Update gdas_gsibec_ver to 20240416 (NOAA-EMC#2497)
  Adding more cycles to gempak script gfs_meta_sa2.sh (NOAA-EMC#2518)
  Update gsi_enkf.sh hash to 457510c (NOAA-EMC#2514)
  Enable using the FV3_global_nest_v1 CCPP suite (NOAA-EMC#2512)
  CI Refactoring and STALLED case detection (NOAA-EMC#2488)
  Add C768 and C1152 S2SW test cases (NOAA-EMC#2509)
  Fix paths for refactored prepocnobs task (NOAA-EMC#2504)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/CD Issue related to CI/CD CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants