-
Notifications
You must be signed in to change notification settings - Fork 87
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
increase wtime_make_orog for RRFS NA 3km on WCOSS #622
Conversation
@chan-hoo, thanks for this PR. Any idea why the orog task is timing out on WCOSS but not on other platforms? If an SDF with GSL GWD is used, there are extra orog fields that are produced, and can cause it to time out. Is that what you're experiencing? Otherwise I'm fine with increasing the wall clock limit (also due to what I just mentioned). I'm not sure why PPN_RUN_FCST was set to 24 for the RRFS_NA_3km domain WE2E test. It's not set in any of the other WE2E tests. Thanks for catching that! (@gsketefian, do you know why it was set to 24 only for this domain?) As for matching EMC's layout values for the RRFS_NA_3km domain, I had originally used the smallest layout possible that would fit within the 8 hour wall clock limit to conserve resources on NOAA HPC, since it's not being run operationally in the App. I'm torn on whether we should match the operational config or not, since it will use significantly more core hours. Thoughts, @gsketefian, @jwolff-ncar, @mkavulich, @llpcarson? |
@JeffBeck-NOAA, 1) This is because 'make_grid' and 'make_orog' run in serial on WCOSS. I tested them in parallel on both wcoss machines, but they didn't work. 3) I'll remove this change. |
@chan-hoo, the grid and orog tasks are run in serial on all NOAA HPC systems, so it may just be that the WCOSS configuration is slower than other machines? There's value in knowing the EMC operational layout configuration for the RRFS_NA_3km domain. Could you add them as comments after the smaller layout values? Something like:
|
@JeffBeck-NOAA , if so .... I have no idea. Maybe you are right. make_orog took about 45 minutes on both wcoss machines. |
DESCRIPTION OF CHANGES:
TESTS CONDUCTED:
WE2E test on WCOSS:
ISSUE:
Fixes issue mentioned in #621