Make thompson_mynn_lam3km ccpp suite available #644

chan-hoo · 2021-12-06T12:12:58Z

DESCRIPTION OF CHANGES:

Make the 'thompson_mynn_lam3km' ccpp suite, which is used at EMC, available in the regional workflow.
Copy and link MERRA2 aerosol climatology data and lookup tables for optics properties.

TESTS CONDUCTED:

grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2

and a new WE2E test on WCOSS dell and cray, and Hera:

grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15_thompson_mynn_lam3km

DEPENDENCIES:

Make thompson_mynn_lam3km ccpp suite available ufs-srweather-app#197

ISSUE:

Fixes issue mentioned in thompson_mynn_lam3km ccpp suite is not available #643
Fixes issue mentioned in link MERRA2 aerosol climatology data #579

CONTRIBUTORS:

@BenjaminBlake-NOAA , @JiliDong-NOAA

ush/config_defaults.sh

ush/setup.sh

JeffBeck-NOAA · 2021-12-06T16:37:54Z

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

chan-hoo · 2021-12-06T16:56:38Z

@JiliDong-NOAA, Can you answer to @JeffBeck-NOAA's comment? And, should I move 'FV3_GFS_v15_thompson_mynn_lam3km' from Ln 182 to between Lns 190-191 in exregional_make_ics.sh (and same change in exregional_make_lbcs.sh)?

JeffBeck-NOAA · 2021-12-06T17:12:57Z

@chan-hoo, I believe you will want to move the SDF from line 182 to ~190-191 in the ex-script IC/LBC creation files, since the main goal there is to correctly handle the aerosols for Thompson. @LarissaReames-NOAA, we should eventually overhaul/rename the varmap tables in UFS_UTILS to no longer be based on "GFS" or "GSL" physics, since people are now running more complicated combinations. @chan-hoo, after you make this change, you'll want to confirm that your gfs_data.nc file, created by chgres_cube, contains the correct aerosol (and other) fields.

JiliDong-NOAA · 2021-12-07T14:28:55Z

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

JeffBeck-NOAA · 2021-12-07T17:20:27Z

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

Thanks, @JiliDong-NOAA. So Thompson MP doesn't use this new MERRA2 dataset at all? If not, what scheme uses it?

JiliDong-NOAA · 2021-12-07T18:49:22Z

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

Thanks, @JiliDong-NOAA. So Thompson MP doesn't use this new MERRA2 dataset at all? If not, what scheme uses it?

@JeffBeck-NOAA the MERRA2 aerosol dataset is for aerosol scheme which is related to but different from microphysics scheme. MERRA2 aerosol can be combined with Thompson MP or GFDL MP. It is also confirmed that we still need to use Thompson_MP_MONTHLY_CLIMO.nc to initialized water/ice friendly aerosol for Thompson MP scheme for now.

JeffBeck-NOAA · 2021-12-08T01:45:56Z

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

Hi @chan-hoo, @JiliDong-NOAA, should this new aerosol dataset used by Thompson replace the climatology that is currently being provided in chgres_cube? The workflow flips the "thomp_mp_climo_file" flag in the chgres_cube namelist to true if Thompson is chosen and if the ICs and LBCs don't come from the RAP or HRRR, which contain aerosol data (see the ex-scripts for ICs/LBCs for this logic). So chgres_cube creates the necessary climo fields in that case. How do these changes work with that climatology?

@JeffBeck-NOAA @chan-hoo the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme. I don't know if we can replace "thomp_mp_climo_file" with the MERRA2 dataset at this point. I will double check with our aerosol expert Anning on this and get back to you.

Thanks, @JiliDong-NOAA. So Thompson MP doesn't use this new MERRA2 dataset at all? If not, what scheme uses it?

@JeffBeck-NOAA the MERRA2 aerosol dataset is for aerosol scheme which is related to but different from microphysics scheme. MERRA2 aerosol can be combined with Thompson MP or GFDL MP. It is also confirmed that we still need to use Thompson_MP_MONTHLY_CLIMO.nc to initialized water/ice friendly aerosol for Thompson MP scheme for now.

Thanks, @JiliDong-NOAA! @chan-hoo, did your test succeed and produce the necessary tracers/aerosols (ice- and water-friendly) when you moved the SDF in the chgres_cube ex-scripts? If you're using non-RAP/HRRR data as ICs/LBCs, you should have gotten the climo aerosol distribution.

chan-hoo · 2021-12-08T12:03:46Z

@JeffBeck-NOAA, with HRRR/RAP, the test run failed with: "fms_io(restore_state_all): unable to find mandatory variable tref in restart file sfc_data.nc". Should I move the SDF line back to Line 182? or are there any other solutions? with FV3GFS/FV3GFS, the test run was complete successfully.

chan-hoo · 2021-12-13T15:52:43Z

@JeffBeck-NOAA, thompson_mynn_lam3km does not run with RAP/HRRR data at this moment. What about putting an error message when it is selected with RAP/HRRR in setup.sh?

JeffBeck-NOAA · 2021-12-13T16:31:46Z

@chan-hoo, did you try moving the suite back to line 182? When you got the error about tref, what does your nstf_name variable look like in your input.nml file?

chan-hoo · 2021-12-13T16:47:27Z

@JeffBeck-NOAA, yes, I did. But I got the same error. In input.nml, "nstf_name = 2, 0, 0, 0, 0".

JeffBeck-NOAA · 2021-12-13T16:51:20Z

ush/templates/FV3.input.yml

+    xkzminv: 0.3
+    xkzm_m: 1.0
+    xkzm_h: 1.0
+
 FV3_GFS_v16:


@chan-hoo, This SDF won't work with RAP/HRRR-based ICs unless "nstf_name" is 2, 1, 0, 0, 0. Does it need to be 2, 0, 0, 0, 0, or can we change it?

I believe that switching the second flag in nstf_name from 0 to 1 means that the NSST data from the surface data file will not be read into the model. If this is not desired/needed, I don't see an issue with changing nstf_name to 2,1,0,0,0

@BenjaminBlake-NOAA, do you have an answer to Jeff's comment? I'll test [2,1,0,0,0] with both FV3GFS and RAP/HRRR.

@chan-hoo I think we added comments at the same time :)

Thanks, @BenjaminBlake-NOAA, @chan-hoo, it looks like we need a switch in the workflow to change the values of nstf_name based on the external model data being used for ICs. Since we don't have that at the moment, the easiest solution is to set all suites to 2,1,0,0,0, in which case, I believe FV3 will spin up its own NSST values.

Thanks, @BenjaminBlake-NOAA. I'll test them.

@JeffBeck-NOAA Yes I think that's right about FV3 spinning up its own NSST values

@JeffBeck-NOAA, @BenjaminBlake-NOAA, both FV3GFS and RAP/HRRR works well with 2,1,0,0,0.

gsketefian · 2021-12-17T18:44:04Z

ush/generate_FV3LAM_wflow.sh

@@ -593,6 +593,25 @@ fi
 #
 #-----------------------------------------------------------------------
 #
+# Copy MERRA2 aerosol climatology data.


@chan-hoo @JeffBeck-NOAA Question: Do these directories need to always be copied or only when using the thompson_mynn_lam3km suite? If the latter, can we wrap them in an if-statement that checks for the suite (i.e. in a new PR, or I can throw it in my current PR)? Just want to reduce the time it takes to generate a new experiment... Thanks.

@gsketefian, Jili answered this question above: "the MERRA2 aero clim dataset is for the independent aerosol module/scheme and not particular for Thompson scheme."

@chan-hoo, is the MERRA2 aero clim dataset only used when running RRFS-CMAQ? If so, then, we may want something like DO_CMAQ="true" in the config.sh file to avoid copying these files unless it's being used.

@JeffBeck-NOAA, No. Since RRFS-CMAQ is coupled with GFS v15, CCPP is not available. MERR2 is used in SRW App (FV3-LAM).

@chan-hoo, right, so CMAQ isn't in the picture. So what component of the SRW App uses the MERRA2 dataset?

@JeffBeck-NOAA, if I understand correctly, it is used in thompson_mynn_lam3km now but it can be selected by other CCPP suites. @JiliDong-NOAA, is this correct? Can we turn it on/off in the fv3 namelist?

@gsketefian @JeffBeck-NOAA , I'll put a flag to turn on/off MERRA2 like 'DO_MERRA' into the regional workflow soon.

chan-hoo added 5 commits December 2, 2021 12:59

Add FV3_GFS_v15_thompson_mynn_lam3km

e599897

Add a we2e test for thompson_mynn_lam3km

816297b

Update namelist files

7a99882

Add MERRA2 data

bf092f0

Merge branch 'feature/merra2' into feature/thompson_mynn

19ae300

chan-hoo requested review from BenjaminBlake-NOAA, gsketefian, JeffBeck-NOAA and mkavulich as code owners December 6, 2021 12:12

chan-hoo mentioned this pull request Dec 6, 2021

Make thompson_mynn_lam3km ccpp suite available ufs-community/ufs-srweather-app#197

Merged

JeffBeck-NOAA reviewed Dec 6, 2021

View reviewed changes

ush/config_defaults.sh Show resolved Hide resolved

JeffBeck-NOAA reviewed Dec 6, 2021

View reviewed changes

ush/setup.sh Show resolved Hide resolved

Fix typos

425a8de

Move the SDF line in scripts

75e0b36

JeffBeck-NOAA reviewed Dec 13, 2021

View reviewed changes

remove change of nstf_name

71dda91

JeffBeck-NOAA approved these changes Dec 13, 2021

View reviewed changes

chan-hoo merged commit bb54e59 into ufs-community:develop Dec 13, 2021

chan-hoo deleted the feature/thompson_mynn branch December 13, 2021 19:50

gsketefian reviewed Dec 17, 2021

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Make thompson_mynn_lam3km ccpp suite available #644

Make thompson_mynn_lam3km ccpp suite available #644

chan-hoo commented Dec 6, 2021

JeffBeck-NOAA commented Dec 6, 2021 •

edited

Loading

chan-hoo commented Dec 6, 2021

JeffBeck-NOAA commented Dec 6, 2021 •

edited

Loading

JiliDong-NOAA commented Dec 7, 2021

JeffBeck-NOAA commented Dec 7, 2021

JiliDong-NOAA commented Dec 7, 2021

JeffBeck-NOAA commented Dec 8, 2021

chan-hoo commented Dec 8, 2021

chan-hoo commented Dec 13, 2021

JeffBeck-NOAA commented Dec 13, 2021

chan-hoo commented Dec 13, 2021

JeffBeck-NOAA Dec 13, 2021 •

edited

Loading

BenjaminBlake-NOAA Dec 13, 2021

chan-hoo Dec 13, 2021

BenjaminBlake-NOAA Dec 13, 2021

JeffBeck-NOAA Dec 13, 2021

chan-hoo Dec 13, 2021

BenjaminBlake-NOAA Dec 13, 2021

chan-hoo Dec 13, 2021

gsketefian Dec 17, 2021

chan-hoo Dec 17, 2021

JeffBeck-NOAA Dec 17, 2021

chan-hoo Dec 17, 2021

JeffBeck-NOAA Dec 17, 2021

chan-hoo Dec 17, 2021

chan-hoo Dec 20, 2021

Make thompson_mynn_lam3km ccpp suite available #644

Make thompson_mynn_lam3km ccpp suite available #644

Conversation

chan-hoo commented Dec 6, 2021

DESCRIPTION OF CHANGES:

TESTS CONDUCTED:

DEPENDENCIES:

ISSUE:

CONTRIBUTORS:

JeffBeck-NOAA commented Dec 6, 2021 • edited Loading

chan-hoo commented Dec 6, 2021

JeffBeck-NOAA commented Dec 6, 2021 • edited Loading

JiliDong-NOAA commented Dec 7, 2021

JeffBeck-NOAA commented Dec 7, 2021

JiliDong-NOAA commented Dec 7, 2021

JeffBeck-NOAA commented Dec 8, 2021

chan-hoo commented Dec 8, 2021

chan-hoo commented Dec 13, 2021

JeffBeck-NOAA commented Dec 13, 2021

chan-hoo commented Dec 13, 2021

JeffBeck-NOAA Dec 13, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

JeffBeck-NOAA commented Dec 6, 2021 •

edited

Loading

JeffBeck-NOAA commented Dec 6, 2021 •

edited

Loading

JeffBeck-NOAA Dec 13, 2021 •

edited

Loading