Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update CMEPS to latest emc/develop #253

Closed
DeniseWorthen opened this issue Oct 28, 2020 · 0 comments
Closed

Update CMEPS to latest emc/develop #253

DeniseWorthen opened this issue Oct 28, 2020 · 0 comments
Assignees
@DeniseWorthen
Labels
enhancement New feature or request

Comments

@DeniseWorthen
Copy link
Collaborator

Description

Update CMEPS to the latest emc/develop branch. This update contains a bugfix for ifrac mapping from ice->atm in both nems_orig and nems_frac mode.

Related to

Dependent on CMEPS PR #22
@DeniseWorthen DeniseWorthen added the enhancement New feature or request label Oct 28, 2020
@DeniseWorthen DeniseWorthen self-assigned this Oct 28, 2020
@DeniseWorthen DeniseWorthen mentioned this issue Oct 28, 2020
Merged
epic-cicd-jenkins pushed a commit that referenced this issue Apr 17, 2023
@christinaholtNOAA
Features/jet partitions (#253)
a3d5e1b 
## DESCRIPTION OF CHANGES: 

Add the ability for forecast jobs on Jet and Hera to use resources more efficiently, and to allow for Jet jobs to run on more partitions, which will be helpful during the HFIP Allocation Season. This involved additional Slurm tags in the rocoto xml, and changing pre-defined grids' layouts and blocksize to be consistent with 

Other changes:

- Converted nthreads to a configurable option in model_configure
- Updated layout and blocksize for GSD_HRRR25km pre-defined grid. 
- Changed dependency for post jobs to also allow for completion of run_fcst to trigger jobs.
- Reduce the number of tries for all tasks to 1. Anything higher is wasteful of resources and time, especially when there are forecast tasks known to fail in the test suite.


The concept adopted here is based on tests performed by Sam Trahan on the AVID real-time setup of HRRR. He found that a more efficient way to run the forecast model is by using the following settings:

    <partition>kjet,xjet,sjet,vjet</partition>
    <cores>240</cores>
    <native>--cpus-per-task 4</native>
    <native>--exclusive</native>

along with `OMP_NUM_THREADS=4`

To adopt these settings in a more general way, he also provided a two rules to follow in order to avoid crashes when choosing layouts and blocksize: 

blocksize <= grid_size_y / layout_y / 2
blocksize >= grid_size_x / layout_x / 2 \

## TESTS CONDUCTED: 
I ran the test suite (except for nco tests) on both Jet and Hera. Applying the above techniques, I fixed a couple of the tests that were already failing for develop -- regional_003, regional_004, and new_JPgrid. (After merging with develop, I realize that new_JPgrid may have already been fixed)

## CONTRIBUTORS: 
@SamuelTrahanNOAA, Dom Heinzeller, and several colleagues in GSL/ATD.
epic-cicd-jenkins pushed a commit that referenced this issue Apr 17, 2023
Check-in Jenkinsfile and unified scripts (#253)
cf89e99 
* Add Jenkinsfile that includes a build and test pipeline, which
leverages the unified build and test scripts
* Supported platforms are Cheyenne, Gaea, and Orion
* Supported compilers are GNU and Intel
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@DeniseWorthen DeniseWorthen

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@DeniseWorthen