Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ci fix #4

Closed
wants to merge 106 commits into from
Closed

Ci fix #4

wants to merge 106 commits into from

Conversation

MinsukJi-NOAA
Copy link

No description provided.

climbfuji and others added 30 commits September 2, 2020 15:31
Add the capability to specify dependencies for CCPP modules/DDTs/schemes in the scheme metadata. This allows us to remove the DDT/scheme dependency information from the CCPP prebuild config in fv3atm and only compile the dependencies and schemes that are used by the selected suite definition files. Until now, all schemes and scheme dependencies are compiled, regardless whether they are in use in any of the selected suites.

Add compiler flags for gfortran-10

Don't run csawmg tests on Cheyenne, both crash with a "bus error"
* add ci-related files. update utest
* modify to auto-run different cases based on ci.test
* Improve CI workflow
* Separate builds and tests into different jobs
* Separate input data from build image; instead, use it as a volume before running tests
* Make ci subdirectory to contain ci-related files
* add clean-up after utest run
* add workflow manage files
* move parsing in main.yml to a separate script file
…h, fix RRTMGP regression tests (ufs-community#201)

* Enable inline post for gnumake builds on hera.gnu, cheyenne.intel, cheyenne.gnu; skip-ci
* Update pull request template, use correct Python interpreter when calling ccpp_prebuild.py in CMakeLists.txt; skip-ci
* tests/rt_utils.sh: remove machine-dependent configuration; skip-ci
* Update ESMF from 8.1.0bs21 to 8.1.0bs27 on almost all machines; skip-ci
* Update .gitmodules and submodule pointer for fv3atm for code review and testing; skip-ci
* Fix RRTMGP regression test setups, temporarily disable RRTMGP tests in tests/rt.conf and tests/rt_gnu.conf
* Updates for docker/ci
* Add note about unit test availability to pull request template
* Update rt.sh configuration for jet, remove tests/rt_rrtmgp.conf, add tests/fv3_conf/compile_slurm.IN_jet
* add link_mpi=dbg for debug test
* add dbg_mt in debug option when OPENMP is on
* update log files for hera, orion, wcoss cray and dell; skip-ci
* update hera.gnu log file
* Set DEBUG_LINKMPI=OFF for cheyenne.intel and gaea.intel; fix post library dependencies for cheyenne.{intel,gnu} gnumake config
* Regression test log for cheyenne.intel

Co-authored-by: Jun Wang <junwang-noaa@users.noreply.github.com>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
* update to latest WW3, 
* update to latest NEMS and stochastic physics branches
* point to new baseline in rt.sh
* wcoss_dell_p3 log, wcoss_cray log, hera.intel log,* orion.intel log
- updates `.gitmodules` and the submodule pointer for fv3atm for code review and testing of the following changes in fv3atm and ccpp-physics:
    - add two new cloud overlap methods for RRTMG to ccpp-physics - see detailed description in NCAR/ccpp-physics#477.
    - add necessary variables to `GFS_typedefs.{F90,meta} and fix a few metadata entries - see NOAA-EMC/fv3atm#157
- contains changes from @DusanJovic-NOAA from branch https://github.com/DusanJovic-NOAA/ufs-weather-model/commits/update_compile_script that removes the old gnumake `compile.sh` script and replaces it with the new cmake `compile_cmake.sh` script (which is renamed to `compile.sh`)
- contains follow-up work in the regression test scripts to use `NEMS_COMPILER` throughout instead of a mixture of `NEMS_COMPILER` and `COMPILER` (note: `NEMS_COMPILER` should be renamed to something like `UFS_COMPILER` or `RT_COMPILER` in the future, along with corresponding changes for `NEMS_MACHINE` etc.)
- fixes the `readlink` command in the top-level `build.sh` and in `tests/compile.sh` for macOS (similar to what was done for branch release/public-v1
- remove lines `cp ${PATHRT}/../FV3/ccpp/suites/suite_${CCPP_SUITE}.xml suite_${CCPP_SUITE}.xml` from `tests/fv3_conf/ccpp*.IN`, i.e. no longer copy suite definition files to regression test run directories
- replace GSL drag suite with CIRES UGWP/GFS GWD in `tests/tests/fv3_ccpp_rrfs_v1beta` and `tests/tests/fv3_ccpp_rrfs_v1beta_debug` (cherry-picked from PR ufs-community#205 for branch release/public-v2)
…ry update in dycore (ufs-community#208)

- updates the submodule pointers for fv3atm, GFDL_atmos_cubed_sphere and ccpp-physics for the following changes:
    - bugfixes for CCPP tendencies output (from @grantfirl)
    - global restart reproducibility (from @SMoorthi-emc)
    - bugfix for halo boundary layer update in FV3 dycore (from @chan-hoo)
- moves directory `parm` into directory `tests`
- updates regression test run scripts for HAFS and SAR to copy input data (`diag_table`, `field_table`, initial conditions) from the regression baseline instead of a temporary directory on hera
- note: the following existing diag_table files in the regression test baseline directory `FV3_input_data_gsd` have been updated to match the requirements for running cycled experiments with the GSL physics (@jkhender @joeolson42 FYI)
    - diag_table_gf_thompson
    - diag_table_gsd_noah
    - diag_table_gsd_ruc
    - diag_table_gsd_ruc_diag3d
…ity#209)

* Use top-level build.sh to compile executables in for regression tests
* Do not copy the executable from build to the top-level directory
- All `#ifdef OPENMP` are replaced with `#ifdef _OPENMP` to follow standard compiler macro for OpenMP.
- CCPP code generation is moved inside of `FV3/`.  This will be redundant when the Data Atmosphere component comes in. Updates to the python script was performed to remove the hard-wired `FV3/` path name in the file.
- `cmake/GNU.cmake` and `cmake/Intel.cmake` hard-wire global compiler definitions with `add_definitions`.  These are now applied with `target_compile_definitions`. 
- CMakeLists.txt is passed through cmake-norm checker.
- `INSTALL_INTERFACE` is added, so that this component can be installed and linked in downstream applications e.g. JEDI. 
This may be incomplete, so will need more work.
…ep 1) to develop (ufs-community#216)

Preparation for transitioning to the next-generation code generator of the ccpp-framework (cap_gen.py).
)

Change horizontal advection options by replacing hord=-6 or -8 with hord=6 or 8 in all ~tests/parm/ *.nml.IN files
* Option to build coupled model
* fix in build.sh
* update modulefiles for orion, hera and wcoss to load pio.  Make PIO optional in CMakeLists.txt if not building S2S
* FMS needs to be linked in MOM6 objects. Add 32BIT and S2S check
* add S2S option to MAKE_OPT
* Add standard s2s tests
* add CICE_IO option (default: NetCDF). Add MOM6 solo executable option (default: OFF) MOM6 library and NUOPC cap are 2 separate entities.
* add debug flags for MOM6 and CICE from @MinsukJi-NOAA
* add debug modulefiles for hera, orion and wcoss_dell_p3
* enable VERBOSE on build only when requested.  Remove -warn flags from CMEPS and MOM6 as they drown out any error messages.  The warnings should be resolved at the upstream repos.  When building with -DDEBUG=ON, set CMAKE_BUILD_TYPE=Debug.

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
add RT_suffix for warm start dependencies
add nsout as a variable in model_configure
white space
Fixes CA test for coupled model
Uses RESTART_N for the coupled model
Removes CNTLMED from tests since weather RT does not use it
links parm/fd_nems.yaml from CMEPS/mediator
* add DATM submodule
* point to aerorahul fork of DATM
* update CMakeList.txt to build data atmosphere.  Add compile test only since there are currently no regression tests for data atmosphere
* update README.md
* missed rsync from develop
* Update README.md
* update DATM submodule pointer and point to NOAA-EMC/NEMSdatm
* create MOM6 solo executable for use in SOCA science
* add compilation tests for s2s and datm for hera.gnu
* commit wcoss_cray RT log, hera.intel RT log
* rsync S2S baselines for intel only on hera and orion
* add orion.intel RT log
* add hera.gnu RT log
* add wcoss_dell_p3 RT log
junwang-noaa and others added 28 commits January 16, 2021 20:45
…perturbed variables (ufs-community#61)

* Updates to regression tests fv3_ccpp_gsd_lndp and fv3_ccpp_gsd_noah_lndp
* Bug fix for tests/parm/ccpp_gsd_sar.nml.IN
…nity#378)

* update CMEPS, fix character length error for gnu compile
* add Dusan's fix for rt_utils.sh
* update cpl gfsv16 tests, replace seaice_newland.grb with global_slmask.t1534.3072.1536.grb, recover input.mom6.nml.IN, update input directory, update global thread and decomp tests, update fdiag for global control
* point to Dustins rrtmgp fix branch
* update input directory

Co-authored-by: denise.worthen <Denise.Worthen@noaa.gov>
Co-authored-by: Jun Wang <junwang-noaa@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.