Skip to content

Commit

Permalink
release/public-v2: replace RRFS v1 beta suite with RRFS v1 alpha suit…
Browse files Browse the repository at this point in the history
…e in regression tests (#313)

- The regional control is now based on the RRFS v1 alpha suite instead of the RRFS v1 beta suite
- An update is made to the blocksize for b4b identical results in global runs with the RRFS v1 alpha suite
- Global RRFS v1 beta tests are removed
  • Loading branch information
climbfuji authored Dec 3, 2020
1 parent 3073eb8 commit 0ad7487
Show file tree
Hide file tree
Showing 31 changed files with 1,032 additions and 862 deletions.
2 changes: 1 addition & 1 deletion parm/ccpp_global.nml.IN
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
/

&atmos_model_nml
blocksize = 32
blocksize = 16
chksum_debug = .false.
dycore_only = .false.
fdiag = @[FDIAG]
Expand Down
187 changes: 142 additions & 45 deletions tests/RegressionTests_cheyenne.gnu.log
Original file line number Diff line number Diff line change
@@ -1,17 +1,17 @@
Thu Nov 12 15:37:03 MST 2020
Wed Dec 2 15:53:40 MST 2020
Start Regression test


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_control_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_control_prod
Checking test 001 fv3_ccpp_regional_control results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Comparing phyf003.nc .........OK
Comparing phyf006.nc .........OK
Comparing phyf012.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf003.nc .........OK
Comparing dynf006.nc .........OK
Comparing dynf012.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Expand All @@ -22,16 +22,14 @@ Checking test 001 fv3_ccpp_regional_control results ....
Test 001 fv3_ccpp_regional_control PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_2threads_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_2threads_prod
Checking test 002 fv3_ccpp_regional_2threads results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Comparing phyf003.nc .........OK
Comparing phyf006.nc .........OK
Comparing phyf012.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf003.nc .........OK
Comparing dynf006.nc .........OK
Comparing dynf012.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Expand All @@ -42,19 +40,37 @@ Checking test 002 fv3_ccpp_regional_2threads results ....
Test 002 fv3_ccpp_regional_2threads PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_regional_coldstart_prod
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_control_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_coldstart_prod
Checking test 003 fv3_ccpp_regional_coldstart results ....
Comparing phyf000.nc .........OK
Comparing phyf003.nc .........OK
Comparing phyf006.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf003.nc .........OK
Comparing dynf006.nc .........OK
Test 003 fv3_ccpp_regional_coldstart PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1beta_prod
Checking test 004 fv3_ccpp_rrfs_v1beta results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_v15p2_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_v15p2_prod
Checking test 004 fv3_ccpp_regional_v15p2 results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Comparing phyf012.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf012.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/sfc_data.nc .........OK
Comparing RESTART/phy_data.nc .........OK
Test 004 fv3_ccpp_regional_v15p2 PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_rrfs_v1alpha_prod
Checking test 005 fv3_ccpp_rrfs_v1alpha results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -129,12 +145,18 @@ Checking test 004 fv3_ccpp_rrfs_v1beta results ....
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 004 fv3_ccpp_rrfs_v1beta PASS
Test 005 fv3_ccpp_rrfs_v1alpha PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1beta_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1beta_coldstart_prod
Checking test 005 fv3_ccpp_rrfs_v1beta_coldstart results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_rrfs_v1alpha_decomp_prod
Checking test 006 fv3_ccpp_rrfs_v1alpha_decomp results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Comparing atmos_4xdaily.tile4.nc .........OK
Comparing atmos_4xdaily.tile5.nc .........OK
Comparing atmos_4xdaily.tile6.nc .........OK
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Comparing phyf000.tile3.nc .........OK
Expand All @@ -147,6 +169,12 @@ Checking test 005 fv3_ccpp_rrfs_v1beta_coldstart results ....
Comparing phyf012.tile4.nc .........OK
Comparing phyf012.tile5.nc .........OK
Comparing phyf012.tile6.nc .........OK
Comparing phyf024.tile1.nc .........OK
Comparing phyf024.tile2.nc .........OK
Comparing phyf024.tile3.nc .........OK
Comparing phyf024.tile4.nc .........OK
Comparing phyf024.tile5.nc .........OK
Comparing phyf024.tile6.nc .........OK
Comparing dynf000.tile1.nc .........OK
Comparing dynf000.tile2.nc .........OK
Comparing dynf000.tile3.nc .........OK
Expand All @@ -158,12 +186,45 @@ Checking test 005 fv3_ccpp_rrfs_v1beta_coldstart results ....
Comparing dynf012.tile3.nc .........OK
Comparing dynf012.tile4.nc .........OK
Comparing dynf012.tile5.nc .........OK
Test 005 fv3_ccpp_rrfs_v1beta_coldstart PASS
Comparing dynf012.tile6.nc .........OK
Comparing dynf024.tile1.nc .........OK
Comparing dynf024.tile2.nc .........OK
Comparing dynf024.tile3.nc .........OK
Comparing dynf024.tile4.nc .........OK
Comparing dynf024.tile5.nc .........OK
Comparing dynf024.tile6.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile2.nc .........OK
Comparing RESTART/fv_tracer.res.tile3.nc .........OK
Comparing RESTART/fv_tracer.res.tile4.nc .........OK
Comparing RESTART/fv_tracer.res.tile5.nc .........OK
Comparing RESTART/fv_tracer.res.tile6.nc .........OK
Comparing RESTART/phy_data.tile1.nc .........OK
Comparing RESTART/phy_data.tile2.nc .........OK
Comparing RESTART/phy_data.tile3.nc .........OK
Comparing RESTART/phy_data.tile4.nc .........OK
Comparing RESTART/phy_data.tile5.nc .........OK
Comparing RESTART/phy_data.tile6.nc .........OK
Comparing RESTART/sfc_data.tile1.nc .........OK
Comparing RESTART/sfc_data.tile2.nc .........OK
Comparing RESTART/sfc_data.tile3.nc .........OK
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 006 fv3_ccpp_rrfs_v1alpha_decomp PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_prod
Checking test 006 fv3_ccpp_rrfs_v1alpha results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_rrfs_v1alpha_2threads_prod
Checking test 007 fv3_ccpp_rrfs_v1alpha_2threads results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -238,12 +299,12 @@ Checking test 006 fv3_ccpp_rrfs_v1alpha results ....
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 006 fv3_ccpp_rrfs_v1alpha PASS
Test 007 fv3_ccpp_rrfs_v1alpha_2threads PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_coldstart_prod
Checking test 007 fv3_ccpp_rrfs_v1alpha_coldstart results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_rrfs_v1alpha_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_rrfs_v1alpha_coldstart_prod
Checking test 008 fv3_ccpp_rrfs_v1alpha_coldstart results ....
Comparing phyf000.tile1.nc .........OK
Comparing phyf000.tile2.nc .........OK
Comparing phyf000.tile3.nc .........OK
Expand All @@ -267,12 +328,12 @@ Checking test 007 fv3_ccpp_rrfs_v1alpha_coldstart results ....
Comparing dynf012.tile3.nc .........OK
Comparing dynf012.tile4.nc .........OK
Comparing dynf012.tile5.nc .........OK
Test 007 fv3_ccpp_rrfs_v1alpha_coldstart PASS
Test 008 fv3_ccpp_rrfs_v1alpha_coldstart PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_gfs_v15p2_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_gfs_v15p2_prod
Checking test 008 fv3_ccpp_gfs_v15p2 results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_gfs_v15p2_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_gfs_v15p2_prod
Checking test 009 fv3_ccpp_gfs_v15p2 results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -335,12 +396,48 @@ Checking test 008 fv3_ccpp_gfs_v15p2 results ....
Comparing RESTART/phy_data.tile4.nc .........OK
Comparing RESTART/phy_data.tile5.nc .........OK
Comparing RESTART/phy_data.tile6.nc .........OK
Test 008 fv3_ccpp_gfs_v15p2 PASS
Test 009 fv3_ccpp_gfs_v15p2 PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_control_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_control_debug_prod
Checking test 010 fv3_ccpp_regional_control_debug results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Comparing phyf001.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf001.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/sfc_data.nc .........OK
Comparing RESTART/phy_data.nc .........OK
Test 010 fv3_ccpp_regional_control_debug PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_regional_v15p2_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_regional_v15p2_debug_prod
Checking test 011 fv3_ccpp_regional_v15p2_debug results ....
Comparing atmos_4xdaily.nc .........OK
Comparing phyf000.nc .........OK
Comparing phyf001.nc .........OK
Comparing dynf000.nc .........OK
Comparing dynf001.nc .........OK
Comparing RESTART/coupler.res .........OK
Comparing RESTART/fv_core.res.nc ............SKIP for gnu compilers
Comparing RESTART/fv_core.res.tile1.nc .........OK
Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
Comparing RESTART/fv_tracer.res.tile1.nc .........OK
Comparing RESTART/sfc_data.nc .........OK
Comparing RESTART/phy_data.nc .........OK
Test 011 fv3_ccpp_regional_v15p2_debug PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_rrfs_v1alpha_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_rrfs_v1alpha_debug_prod
Checking test 009 fv3_ccpp_rrfs_v1alpha_debug results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_rrfs_v1alpha_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_rrfs_v1alpha_debug_prod
Checking test 012 fv3_ccpp_rrfs_v1alpha_debug results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -403,12 +500,12 @@ Checking test 009 fv3_ccpp_rrfs_v1alpha_debug results ....
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 009 fv3_ccpp_rrfs_v1alpha_debug PASS
Test 012 fv3_ccpp_rrfs_v1alpha_debug PASS


baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201112/GNU/fv3_gfs_v15p2_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_1140/fv3_ccpp_gfs_v15p2_debug_prod
Checking test 010 fv3_ccpp_gfs_v15p2_debug results ....
baseline dir = /glade/p/ral/jntp/GMTB/ufs-weather-model/RT/NEMSfv3gfs/ufs-public-release-v2-20201202/GNU/fv3_gfs_v15p2_debug_ccpp
working dir = /glade/scratch/heinzell/FV3_RT/rt_52813/fv3_ccpp_gfs_v15p2_debug_prod
Checking test 013 fv3_ccpp_gfs_v15p2_debug results ....
Comparing atmos_4xdaily.tile1.nc .........OK
Comparing atmos_4xdaily.tile2.nc .........OK
Comparing atmos_4xdaily.tile3.nc .........OK
Expand Down Expand Up @@ -471,9 +568,9 @@ Checking test 010 fv3_ccpp_gfs_v15p2_debug results ....
Comparing RESTART/sfc_data.tile4.nc .........OK
Comparing RESTART/sfc_data.tile5.nc .........OK
Comparing RESTART/sfc_data.tile6.nc .........OK
Test 010 fv3_ccpp_gfs_v15p2_debug PASS
Test 013 fv3_ccpp_gfs_v15p2_debug PASS


REGRESSION TEST WAS SUCCESSFUL
Thu Nov 12 15:50:20 MST 2020
Elapsed time: 00h:13m:18s. Have a nice day!
Wed Dec 2 16:10:13 MST 2020
Elapsed time: 00h:16m:33s. Have a nice day!
Loading

0 comments on commit 0ad7487

Please sign in to comment.