Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GFSv15.2.7 changes #7

Closed
KateFriedman-NOAA opened this issue Dec 30, 2019 · 8 comments
Closed

GFSv15.2.7 changes #7

KateFriedman-NOAA opened this issue Dec 30, 2019 · 8 comments
Assignees
Labels
production update Processing update in production

Comments

@KateFriedman-NOAA
Copy link
Member

KateFriedman-NOAA commented Dec 30, 2019

The GFS was updated in operations to v15.2.7 to update a post script and pull in new CO2 fix files:

SVN Log:
------------------------------------------------------------------------
r107 | simon.hsiao@noaa.gov | 2019-12-27 00:06:50 +0000 (Fri, 27 Dec 2019) | 1 line
Changed paths:
   A /trunk/fix/fix_am/co2dat_4a/global_co2historicaldata_2018.txt
   A /trunk/fix/fix_am/co2dat_4a/global_co2historicaldata_2019.txt_proj_u
   A /trunk/fix/fix_am/co2dat_4a/global_co2historicaldata_2020.txt_proj
   A /trunk/fix/fix_am/fix_co2_proj/global_co2historicaldata_2020.txt
   A /trunk/fix/fix_am/fix_co2_update/global_co2historicaldata_2019.txt
   M /trunk/scripts/exgfs_nceppost.sh.ecf

 ARFC 2020 CO2 prediction files updates and add dbn_alert GFS gfs.txxz.special.grb2fxxx for NHC

From January 10th RFC memo:

RFC 6384 – On WCOSS, added the 2020 CO2 projection file to several model fix directories (cfs.v2.1.33, gfs.v15.2.7, gsm.v12.1.6, hiresw.v7.0.15, hmon.v2.1.2, nam.v4.1.15, and sref.v7.0.23). Fixed the NAM exec/dell.exec/nam_post0 bug that caused model profiles at station locations to write out pressure values of zero for many stations. Added a dbn_alert for the GFS gfs.txxz.special.grb2fxxx product per an NHC request. Implemented on December 23 at 1300Z.

Nothing to process for new fix files, they are already in the FIX_DIRs on supported platforms and latest HPSS tarball.

Did a rsync of ../nwprod/gfsv15.2.7 into copy of operations branch and found one text change to transfer parm file that needs to get pulled in:

diff --git a/parm/transfer_gdas_misc.list b/parm/transfer_gdas_misc.list
index d65e801e..7768f72a
--- a/parm/transfer_gdas_misc.list
+++ b/parm/transfer_gdas_misc.list
@@ -23,7 +23,7 @@
 # directory are included, so if no exclude patterns match that file, it will be
 # transferred.

-com/arch/_ENVIR_/syndat/
+com/gfs/_ENVIR_/syndat/

Diffs of that transfer list file between the recent GFS versions found the change happened in v15.2.5. Diffs performed while processing changes for v15.2.5 and v15.2.6 did not show this change. Pulling it into the operations and develop branches none-the-less.

Plan of action:

  1. delete NCO-v15.2.6 tag
  2. pull change to parm/transfer_gdas_misc.list into the operations branch
  3. remake NCO-v15.2.6 tag off operations branch
  4. if post script change is in new tag will update EMC_post tag in operations branch
  5. make NCO-v15.2.7 tag off operations branch

#4 will depend on if there is a new EMC_post tag. @WenMeng-NOAA is there a new EMC_post tag for the change to exgfs_nceppost.sh.ecf in production?

Will wait to perform above actions until folks are back from holiday leave next week.

@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Dec 30, 2019
@KateFriedman-NOAA KateFriedman-NOAA added the production update Processing update in production label Jan 7, 2020
@KateFriedman-NOAA
Copy link
Member Author

Wen pulled the post script change into EMC_post on VLab and made new tags:

  1. general UPP EMC_post: ncep_post.v8.1.5
  2. UPP with gtg EMC_post_gtg: ncep_post_gtg.v1.1.11

The non-gtg tag will go into develop branch and the gtg tag will go into operations branch.

@KateFriedman-NOAA
Copy link
Member Author

Pulled transfer file from nwprod into clones of develop and operations branches:

/gpfs/dell1/nco/ops/nwprod/gfs.v15.2.7/parm/transfer_gdas_misc.list

Updated operations branch EMC_post tag to ncep_post_gtg.v1.1.11. Not going to update develop branch EMC_post tag since it's from VLab and the develop branch now points to GitHub repo.

@KateFriedman-NOAA
Copy link
Member Author

Deleted current NCO-v15.2.6 tag:

[Kate.Friedman@m71a1 CM_operations]$ git tag -d NCO-v15.2.6
Deleted tag 'NCO-v15.2.6' (was 7b182d55)
[Kate.Friedman@m71a1 CM_operations]$ git push origin --delete NCO-v15.2.6
To https://github.com/NOAA-EMC/global-workflow.git
 - [deleted]           NCO-v15.2.6

@KateFriedman-NOAA
Copy link
Member Author

Remade NCO-v15.2.6 tag off operations branch:

[Kate.Friedman@m71a1 global-workflow]$ git clone https://github.com/NOAA-EMC/global-workflow.git ./CM_operations_tag
Cloning into './CM_operations_tag'...
remote: Enumerating objects: 15, done.
remote: Counting objects: 100% (15/15), done.
remote: Compressing objects: 100% (14/14), done.
remote: Total 29669 (delta 1), reused 4 (delta 1), pack-reused 29654
Receiving objects: 100% (29669/29669), 68.50 MiB | 29.25 MiB/s, done.
Resolving deltas: 100% (20227/20227), done.
[Kate.Friedman@m71a1 global-workflow]$ cd ./CM_operations_tag
[Kate.Friedman@m71a1 CM_operations_tag]$ git checkout operations
Branch operations set up to track remote branch operations from origin.
Switched to a new branch 'operations'
[Kate.Friedman@m71a1 CM_operations_tag]$ git log -1
commit e6f52d73b3f68dac81117402ff1a8219a23ef287 (HEAD -> operations, origin/operations)
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Jan 8 19:28:47 2020 +0000

    Issue #7 - missed change from v15.2.5 to gdas transfer parm file
[Kate.Friedman@m71a1 CM_operations_tag]$ git tag -a NCO-v15.2.6 -m "NCO GFSv15.2.6"
[Kate.Friedman@m71a1 CM_operations_tag]$ git push origin NCO-v15.2.6
Counting objects: 1, done.
Writing objects: 100% (1/1), 169 bytes | 169.00 KiB/s, done.
Total 1 (delta 0), reused 0 (delta 0)
To https://github.com/NOAA-EMC/global-workflow.git
 * [new tag]           NCO-v15.2.6 -> NCO-v15.2.6

@KateFriedman-NOAA
Copy link
Member Author

Pulled transfer parm file into develop branch and committed back:

[Kate.Friedman@m71a1 CM_develop]$ git branch
* develop
[Kate.Friedman@m71a1 CM_develop]$ git status
On branch develop
Your branch is up-to-date with 'origin/develop'.

Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

        modified:   parm/transfer_gdas_misc.list

[Kate.Friedman@m71a1 CM_develop]$ git commit -m "Issue #7 - missed update to gdas transfer file from GFSv15.2.5 updates"
[develop 091f4ba1] Issue #7 - missed update to gdas transfer file from GFSv15.2.5 updates
 1 file changed, 1 insertion(+), 1 deletion(-)
 mode change 100644 => 100755 parm/transfer_gdas_misc.list
[Kate.Friedman@m71a1 CM_develop]$ git push origin develop
Counting objects: 4, done.
Delta compression using up to 56 threads.
Compressing objects: 100% (4/4), done.
Writing objects: 100% (4/4), 407 bytes | 407.00 KiB/s, done.
Total 4 (delta 3), reused 0 (delta 0)
remote: Resolving deltas: 100% (3/3), completed with 3 local objects.
To https://github.com/NOAA-EMC/global-workflow.git
   3fd4bcfa..091f4ba1  develop -> develop

@KateFriedman-NOAA
Copy link
Member Author

Updated EMC_post gtg tag in operations branch:

[Kate.Friedman@m71a1 global-workflow]$ git clone https://github.com/NOAA-EMC/global-workflow.git ./CM_operations
Cloning into './CM_operations'...
remote: Enumerating objects: 19, done.
remote: Counting objects: 100% (19/19), done.
remote: Compressing objects: 100% (18/18), done.
remote: Total 29673 (delta 2), reused 6 (delta 1), pack-reused 29654
Receiving objects: 100% (29673/29673), 68.50 MiB | 29.51 MiB/s, done.
Resolving deltas: 100% (20228/20228), done.
[Kate.Friedman@m71a1 global-workflow]$ cd ./CM_operations
[Kate.Friedman@m71a1 CM_operations]$ git checkout operations
Branch operations set up to track remote branch operations from origin.
Switched to a new branch 'operations'
[Kate.Friedman@m71a1 CM_operations]$ git branch
  develop
* operations
[Kate.Friedman@m71a1 CM_operations]$ vi sorc/checkout.sh
[Kate.Friedman@m71a1 CM_operations]$ git diff sorc/checkout.sh
diff --git a/sorc/checkout.sh b/sorc/checkout.sh
index 40372976..5b1f803f 100755
--- a/sorc/checkout.sh
+++ b/sorc/checkout.sh
@@ -35,7 +35,7 @@ if [[ ! -d gfs_post.fd ]] ; then
     git clone --recursive gerrit:EMC_post_gtg gfs_post.fd >> ${topdir}/checkout-gfs_post.log 2>&1
     cd gfs_post.fd
     #git checkout ncep_post.v8.0.27e
-    git checkout ncep_post_gtg.v1.1.10
+    git checkout ncep_post_gtg.v1.1.11
     cd ${topdir}
 else
     echo 'Skip.  Directory gfs_post.fd already exists.'
[Kate.Friedman@m71a1 CM_operations]$ git add sorc/checkout.sh
[Kate.Friedman@m71a1 CM_operations]$ git commit -m "Issue #7 - update to EMC_post gtg tag for GFSv15.2.7"
[operations 76fa32f8] Issue #7 - update to EMC_post gtg tag for GFSv15.2.7
 1 file changed, 1 insertion(+), 1 deletion(-)
[Kate.Friedman@m71a1 CM_operations]$ git push origin operations
Counting objects: 4, done.
Delta compression using up to 56 threads.
Compressing objects: 100% (4/4), done.
Writing objects: 100% (4/4), 398 bytes | 398.00 KiB/s, done.
Total 4 (delta 3), reused 0 (delta 0)
remote: Resolving deltas: 100% (3/3), completed with 3 local objects.
To https://github.com/NOAA-EMC/global-workflow.git
   e6f52d73..76fa32f8  operations -> operations

@KateFriedman-NOAA
Copy link
Member Author

Made new NCO-v15.2.7 tag off operations branch:

[Kate.Friedman@m71a1 CM_operations]$ git branch
  develop
* operations
[Kate.Friedman@m71a1 CM_operations]$ git tag -a NCO-v15.2.7 -m "NCO GFSv15.2.7"
[Kate.Friedman@m71a1 CM_operations]$ git push origin NCO-v15.2.7
Counting objects: 1, done.
Writing objects: 100% (1/1), 170 bytes | 170.00 KiB/s, done.
Total 1 (delta 0), reused 0 (delta 0)
To https://github.com/NOAA-EMC/global-workflow.git
 * [new tag]           NCO-v15.2.7 -> NCO-v15.2.7

@KateFriedman-NOAA
Copy link
Member Author

Send commit announcements to users. Closing issue now.

jkhender added a commit to jkhender/global-workflow that referenced this issue Mar 31, 2020
Squashed commit of the following:

commit 0e0dc87
Merge: b133700 95a6343
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Thu Mar 26 10:54:44 2020 -0400

    Merge pull request NOAA-EMC#42 from NOAA-EMC/hotfix/viewer

    Issue NOAA-EMC#41 - Update PRODUTIL paths for WCOSS in viewer

commit 95a6343
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Thu Mar 26 14:43:44 2020 +0000

    Issue NOAA-EMC#41 - Update PRODUTIL paths for WCOSS in viewer

commit b133700
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Thu Mar 26 13:01:38 2020 +0000

    Issue NOAA-EMC#21 - correct syntax for machine if-blocks in setup_expt scripts

commit f4ee509
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Mar 25 20:52:49 2020 +0000

    Issue NOAA-EMC#21 - remove unneeded logic from partition check

commit 4acc80f
Merge: accb6f4 fb1c79f
Author: Hang-Lei-NOAA <44901908+Hang-Lei-NOAA@users.noreply.github.com>
Date:   Wed Mar 25 15:22:51 2020 -0400

    Merge pull request NOAA-EMC#40 from NOAA-EMC/port2wcoss3p5

    Issue NOAA-EMC#21 - Add support for WCOSS phase 3.5

commit fb1c79f
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Mar 25 16:06:54 2020 +0000

    Issue NOAA-EMC#21 - updated WCOSS phase 3.5 queues

commit 08a5354
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Mar 25 14:58:14 2020 +0000

    Issue NOAA-EMC#21 - add phase 3.5 support

    - add partition option to setup scripts
    - remove machine if-blocks from config.base and add variable population to setup_expt*py scripts
    - add phase 3.5 ppn value to WCOSS_DELL_P3 env and config.resources files

commit accb6f4
Merge: 057b2a8 8b51b56
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Mon Mar 23 14:01:30 2020 -0400

    Merge pull request NOAA-EMC#39 from NOAA-EMC/feature/verif-tag

    Issue NOAA-EMC#38 - update EMC_verif-global pointer from VLab to GitHub

commit 8b51b56
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Mon Mar 23 17:40:18 2020 +0000

    Issue NOAA-EMC#38 - update EMC_verif-global pointer from VLab to GitHub

commit 057b2a8
Merge: 0377d20 622167d
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Wed Mar 11 12:00:58 2020 -0400

    Merge pull request NOAA-EMC#29 from NOAA-EMC/feature/manage_externals

    Issue NOAA-EMC#3 - Introduce manage_externals as replacement for checkout.sh

commit 622167d
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 18:20:31 2020 +0000

    Issue NOAA-EMC#3 - added explicit config flag example for checkout_externals in README and blurb about this replacing checkout.sh

commit e83b90d
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 17:00:15 2020 +0000

    Issue NOAA-EMC#3 - remove prod_util and grib_util sections from build_all.sh, removed elsewhere already

commit 8699b46
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 16:30:54 2020 +0000

    Issue NOAA-EMC#3 - updated README with new manic version

commit e602cd3
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 16:27:57 2020 +0000

    Issue NOAA-EMC#3 - updated link_fv3gfs.sh to adjust wafs links

commit 830c73f
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 15:21:45 2020 +0000

    Issue NOAA-EMC#3 - update EMC_verif-global tag in Externals.cfg after sync with develop

commit 40084e6
Merge: f662fff 0377d20
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Mar 6 15:18:52 2020 +0000

    Issue NOAA-EMC#3 - Merge branch 'develop' into feature/manage_externals

commit 0377d20
Merge: 1b359db 2552467
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Thu Mar 5 08:43:16 2020 -0500

    Merge pull request NOAA-EMC#28 from NOAA-EMC/feature/metplus2

    Issue NOAA-EMC#8 - add switch for MET+ jobs

commit 2552467
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Thu Mar 5 13:31:02 2020 +0000

    Issue NOAA-EMC#8 - add switch for MET+ jobs

commit 1b359db
Merge: 0359d34 31bb7d3
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Wed Mar 4 10:19:36 2020 -0500

    Merge pull request NOAA-EMC#26 from NOAA-EMC/feature/metplus

    Feature/metplus - refactored MET+ jobs to resolve timing issues

commit 31bb7d3
Merge: eb73e52 0359d34
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Wed Feb 19 15:24:42 2020 +0000

    Merge branch 'develop' into feature/metplus

commit f662fff
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Feb 14 15:57:05 2020 +0000

    Issue NOAA-EMC#3 - Updated README with new manic tag v1.1.7

commit e3196a8
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Thu Feb 13 15:59:06 2020 -0500

    Update README.md

commit e46b175
Merge: 4bd0e20 0359d34
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Thu Feb 13 20:38:04 2020 +0000

    Issue NOAA-EMC#3 - sync merge with develop branch

commit 0359d34
Merge: 1d9a1f0 bd00cb9
Author: Hang-Lei-NOAA <44901908+Hang-Lei-NOAA@users.noreply.github.com>
Date:   Thu Feb 13 09:53:59 2020 -0500

    Merge pull request NOAA-EMC#19 from NOAA-EMC/feature/remove_theia

    Feature/remove theia

commit eb73e52
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Fri Feb 7 14:04:37 2020 +0000

    Update EMC_verif-global checkout to verif_global_v1.5.0

commit bd00cb9
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Fri Feb 7 13:41:05 2020 +0000

    Issue NOAA-EMC#4 - bug fix in getic.sh for v15

commit 1c85197
Merge: 67dae40 1d9a1f0
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Fri Feb 7 13:27:18 2020 +0000

    Issue # 4 - Sync merge branch 'develop' into feature/remove_theia

commit 1d9a1f0
Merge: 3ed9267 bdbecaa
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Fri Feb 7 08:11:21 2020 -0500

    Merge pull request NOAA-EMC#18 from lgannoaa/exception_handling

    Exception handling

commit 4bd0e20
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Thu Feb 6 11:55:31 2020 -0500

    Update README.md

commit d9ea1ac
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Thu Feb 6 16:03:11 2020 +0000

    Issue NOAA-EMC#3 - reduce hashes down to minimum 8 characters

commit bdbecaa
Author: Lin.Gan <lin.gan@noaa.gov>
Date:   Wed Jan 29 15:15:52 2020 +0000

    Display exception handling message for individual package with location of the log file

commit b64fd5f
Merge: cf00863 3ed9267
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Tue Jan 28 15:24:37 2020 +0000

    Merge branch 'develop' into feature/manage_externals

commit cf00863
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Tue Jan 28 15:23:14 2020 +0000

    Issue NOAA-EMC#3 - remove copy of manage_externals under util and add README.md file

commit c12e879
Author: Lin.Gan <lin.gan@noaa.gov>
Date:   Mon Jan 27 19:38:19 2020 +0000

    Implement exception handling in build_all script

commit bfc7bb0
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Mon Jan 27 19:06:17 2020 +0000

    Issue NOAA-EMC#3 - initial add of manage_externals and needed Externals.cfg. Also added .gitignore file and removed scripts/files associated with no-longer-used prod_util and grid_util builds.

commit 4d5713d
Author: Lin.Gan <lin.gan@noaa.gov>
Date:   Fri Jan 24 15:51:28 2020 +0000

    Testing github commit

commit 786806f
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Fri Jan 24 15:04:16 2020 +0000

    Missed file format updates in a few places in config.metp

commit d0a3b53
Author: Lin.Gan <lin.gan@noaa.gov>
Date:   Fri Jan 24 14:30:29 2020 +0000

    init commit for exception handling branch

commit c11dfef
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Fri Jan 24 14:07:29 2020 +0000

    Update EMC_verif-global tag to verif_global_v1.4.1

commit 0ea809c
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Thu Jan 23 13:29:56 2020 +0000

    Update file format variable in config.metp of online archive files

commit c0d7179
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Tue Jan 21 16:37:16 2020 +0000

    Add updated env machine files for gfsmetp

commit 82e6907
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Tue Jan 21 16:29:23 2020 +0000

    Update config.resources for gfsmetp

commit 72e8adf
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Tue Jan 21 16:19:31 2020 +0000

    Update EMC_verif-global tag checkout to 1.4.0

commit 6872f79
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Tue Jan 21 16:14:25 2020 +0000

    Add rocoto METplus job script

commit 9c94156
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Tue Jan 21 16:09:13 2020 +0000

    Changes to setup_workflow.py for gfsmetp metatask

commit 3ed9267
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Tue Jan 14 19:32:36 2020 +0000

    Issue NOAA-EMC#10 - mid-year update to bufr station list (develop)

commit 1915aa9
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Fri Jan 10 18:36:32 2020 +0000

    Issue NOAA-EMC#8 - pulled in config.metp and modifications to two setup scripts

commit 67dae40
Merge: f78eb1b 091f4ba
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Jan 8 20:15:45 2020 +0000

    Merge branch 'develop' into feature/remove_theia

commit f78eb1b
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Jan 8 20:13:08 2020 +0000

    Issue NOAA-EMC#4 - removed references to Theia and Theia scripts

commit 091f4ba
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Wed Jan 8 19:37:45 2020 +0000

    Issue NOAA-EMC#7 - missed update to gdas transfer file from GFSv15.2.5 updates

commit 3fd4bcf
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Tue Dec 17 19:12:28 2019 +0000

    GitHub Issue NOAA-EMC#2 - GFSv15.2.6 obsproc version update, earc bug fix, and tracker path update

commit 5307952
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Wed Dec 11 20:47:44 2019 +0000

    HOTFIX - VLab Issue #72346 - fix to rocoto_viewer on Hera
WalterKolczynski-NOAA added a commit that referenced this issue May 14, 2020
Adding DOPNT dependency around point output block in exwave_post_sbs
lgannoaa pushed a commit to lgannoaa/global-workflow that referenced this issue Feb 9, 2022
…utput; 2)Use bilinear interpolation for land-sea mask(LAND) in pgrb2 files. (NOAA-EMC#7)
lgannoaa pushed a commit to lgannoaa/global-workflow that referenced this issue Feb 9, 2022
* Turn on GSD cloud ceiling calculation for RRFS dev.

* Updates to UPP for RRFS applications (NOAA-EMC#3)

* Updates to UPP for RRFS applications:
1) Adding a RRFS-specific .xml control file and a corresponding .txt flat file.  Note that script changes (pending) are needed to leverage the new flat file.  However, this code will work in current real-time configurations.
2) Adding GSL experimental ceiling diagnostics, GSL visibility diagnostic, and GSL sea-level pressure reduction (MAPS).  Also adding TKE and aerosol number concentrations.
3) Code clean-up for ceiling-related diagnostics; added comments, etc.
4) Removing several non-needed variables, originally inherited from FV3-SAR community configuration.

* Updating UPP control files to specify GRIB2 generating center as "noaa_fsl_boulder" and the generating process as "hrrr".  The "hrrr" specification is temporary, and will eventually be switched to "rrfs" once required changes to the "NCEPLIBS-g2tmpl" library are available. (NOAA-EMC#4)

* Fix some out-of-bounds reads that caused the RRFS UPP to crash. (NOAA-EMC#5)

* Adding README file (NOAA-EMC#7)

* Adding README file to describe process of making a "flat" file.

* Updates to README to improve explanation of input/output files.

* Code to read in Flash Flood Guidance (FFG) and Average Recurrence Interval (ARI) precipitation datasets for comparison with model QPF within UPP.

* Fixed a syntax error in SURFCE.f

* Getting rid of GRIB1 output option to be consistent with rest of code.

* Changing field numbers to avoid conflict with existing RRFS-dev1 fields.

* Putting exceedance grids in flat files for testing in RRFS UPP.

* Corrected the 1h and run total precip names for calculating exceedances in SURFCE.f

* Bug fix in SURFCE.f if statements.

* Removing changes to RQSTFLD.F since GRIB1 is no longer used in UPP.

* Merging NOAA-GSL development on top of NOAA-EMC UPP for testing.

* Correcting minor typos in SURFCE.f to allow testing.

* Update code based on testing with RRFS cases.

* Update part of the code based on current EMC develop branch for comparing the test results with the merged version.(NOAA-EMC#9)

* Fixed several bugs in the code.

* Modifications to SURFCE.f to check for existence of FFG files.

* Bug fixes for FFG file existence check, and changes to handle rotated lat-lon grid interpolation for FFG

* Bug fixes for FFG existence checks in SURFCE.f

* Another bug fix for SURFCE.f

* Updating XML and flat txt files to include a 65th vertical level to be consistent with updated FV3LAM model with higher model top. (NOAA-EMC#13)

* Code cleanup for QPF - FFG comparison.  Comparison put into subroutine.

* Cleanup of SURFCE.f; moving the FFG comparisons into a subroutine.

* Final cleanup of exceedance code for QPF vs FFG.

* Removing some commented out variable declarations.

* Additional cleanup recommended by Ming: we really only need two exceedance variables; one for 1h FFG and one for run total FFG exceedances.

* Further cleanup of FFG code, simplifying to two fields (1h acc and run total acc)

* Adding ARI comparison fields for 2y, 5y, 10y, and 100y ARIs.

* Changes to output 9 soil levels from FV3LAM if we are running 9 level RUC LSM.

* Adding flat txt file for UPP.

* Commenting out the use of the ARI exceedances for now.  We can switch them on later.

* Bug fix in INITPOST_NETCDF.f : need to use both ncid2d and ncid3d in this subroutine!

* Adding NOAA-GSL code changes on top of latest NOAA-EMC UPP.

* Couple of bug fixes in NOAA-EMC code.  Bugs were leading to PRMSL and -10C REFD being all zeroes.

* Cleaning up code to get rid of unnecessary differences from EMC.

* Putting all new GSL variables into EMC's unified post_avblflds.xml.  Note that EMC's unified post_avblflds.xml does not validate using the avblflds Schema.

* Updating postconfig-NT.txt file for GSL RRFS based on merged post_avblflds.xml file.

* Adding RRFS control files to makefile.

* Changing back scale for WEASD_ON_SURFACE to previous default, thanks to suggestion from Wen Meng.

* Reverting name of cldfra based on feedback from Eric Aligo.

* Reverting changes in fv3lam_post_avblflds.xml since GSL new variables are now included in post_avblflds.xml

* Changing experimental ceiling level type from "ceiling" to "cloud_ceilng"

* Updating 3drtma_postcntrl.xml with revised name for GSD_EXP_CEILING.  This also affects postxconfig-NT-3drtma.txt.  postxconfig-NT-fv3lam_rrfs.txt also changed due to changes in post_avblflds.xml

* Introducing if statement for call of NGMSLP, to avoid calling unless it is needed.

Co-authored-by: Ming.Hu <Ming.Hu@noaa.gov>
Co-authored-by: Christina Holt <56881914+christinaholtNOAA@users.noreply.github.com>
Co-authored-by: Christina Holt <Christina.Holt@noaa.gov>
Co-authored-by: Jaymes Kenyon <jaymes.kenyon@noaa.gov>
Co-authored-by: Samuel Trahan (NOAA contractor) <39415369+SamuelTrahanNOAA@users.noreply.github.com>
zhanglikate pushed a commit to zhanglikate/global-workflow that referenced this issue Oct 6, 2022
…nter_fv3atm

dtc/develop: update submodule pointer for fv3atm 2019/11/25
zhanglikate pushed a commit to zhanglikate/global-workflow that referenced this issue Oct 6, 2022
…develop

gsd/develop: update from from develop 2020/01/27
zhanglikate pushed a commit to zhanglikate/global-workflow that referenced this issue Oct 6, 2022
…bm_ic directory out of inputdata directory; use aws ec2 for CI test; auto-rt fixes (NOAA-EMC#426)

* Modifications to run tests on aws ec2 instances
* Change layout numbers. Include all utests (NOAA-EMC#7)
* Remove unnecessary sleep in build_test.yml and buidl_status_check.py
* Increase sleep period in build_status_check.py to meet 60 requests/hr
* Add sleep back to build_status.check.py
* Minor changes. Change CI to develop branch
* update diag_tables
*add config variable for diag_table
*set up diag_table templates for benchmarks (pre/v16) versions
* fix diag table variable for v16 tests
* add 35 v16 bmark frac test
* add missing diag_table in bmark restart tests
* Move bm_ic directory out of input-data directory
* Replace sys exit with valueError in build_status_check.py
* updates for v16 stability
* remove un-used dz_min=6 parameter setting in bmark v16 tests
* add psm_bc variable and set to value of 1 (default 0) for v16 tests
* set dt_atmos=225 in v16 tests
* updates for dated BM_IC directory
* add INPUTDATA_ROOT_BMIC to rt.sh
* remove BM_IC variable in cpld_bmark_run.IN and use explict path to specify IC sources for ATM,MOM6,CICE5 and WW3 (only for 35d test)
* add variables in parm/input.benchmark_v16.nml.IN
* set dddmp = 0.2 and FSICL to 0 in v16 bmark tests
* modify v16 tests
* keep FSICL at default value for now
* reduce time for v16 wave test to 6hr
* update RTPWD to 20130308; skip-ci
* fix cpld_bmarkfrac_wave_v16 test
* fix timestamps on files for comparison to baseline after switching to 6hour test length
* remove restart file from WW3 comparison. Currently the restart file writes out only at hour 12. This is set in ww3_multi.inp. A change to allow writing a restart at hour 6 would require an update to the ww3 input data directory

Co-authored-by: MinsukJi-NOAA <minsuk.ji@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>
EricSinsky-NOAA pushed a commit to EricSinsky-NOAA/global-workflow that referenced this issue Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
production update Processing update in production
Projects
None yet
Development

No branches or pull requests

1 participant