forked from NOAA-EMC/global-workflow
-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix missing COMROOT setting for Orion #1
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
* jobs/rocoto/ecen.sh - remove FHSFC_ECEN * ush/rocoto/setup_workflow.py - remove fhrsfc and associated scripting
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
…og file dependency for post000 job
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
(1) provide default defintion for CONVNETC (2) update WCOSS_DELL_P3 fitdir
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
… in exglobal_fcst_nemsfv3gfs.sh
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
to save sfcanl for running gldas as ICs
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
…t DOSFCANL_ENKF in config.esfc
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jan 22, 2021
Merge branch 'develop' at revision 3ed9267 into feature/gfsv16b
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- ecflow forecast scripts changes for resources - fixes to prdgen wave scripts Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- add line to config.fcst to allow running gdas and gfs with different threading - add nth_fv3_gfs to config.fv3 to support different threading for gfs - changes to post settings in config.resources to make post use all tasks on a node and speed up post jobs Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- NCO requested that KEEPDATA be removed from config.base and config.fcst since KEEPDATA gets set at the ecflow level and shouldn't be changed by the configs lower down. - Already commented out in config.fcst in prior commit. - Removed KEEPDATA from config.base.nco.static since it becomes config.base in prod mode with ecflow. - Retaining KEEPDATA in config.base.emc.dyn since that only becomes config.base in dev mode (rocoto doesn't set KEEPDATA). Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- new tag includes changes made locally in NCO nwpara/gfsv16.0.7 install Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- added symlinks in link_fv3gfs.sh for wafs_blending_0p25.fd and wafs_grib2_0p25.fd Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- added parm/config/config.resources.nco.static; contains resources for operations - added copy of config.resources.nco.static in link_fv3gfs.sh when nco mode Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- Final nwprod implementation component tag versions set in Externals.cfg and checkout.sh - GLDAS: roll back to gldas_gfsv16_release.v1.12.0 - EMC_verif-global: roll back to verif_global_v1.11.0 - WAFS: update in Externals.cfg to gfs_wafs.v6.0.19 Notes about local nwprod install changes: - EMC_post: nwprod install shows upp_gfsv16_release.v1.1.1 tag but contains local updates found in upp_gfsv16_release.v1.1.3 tag - WAFS: nwprod install shows gfs_wafs.v6.0.17 tag but contains local updates found in gfs_wafs.v6.0.19 tag Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
- updates to the transfer parm files were erroneously committed after a diff between nwpara/gfsv16.0.7 and release/gfsv16.0.0 branch; v16.0.7 had been moved to nwprod/gfsv16.0.7 and transfer parm file diffs were not in final install - confirmed with SPA Jen that nwprod/gfsv16.0.7 is finalized (it is) - pulled in transfer parm files from nwprod/gfsv16.0.7 to sync them again Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
Merge remote-tracking branch 'origin/release/gfsv16.0.0' into release/gfsv16.0.0_to_ops * origin/release/gfsv16.0.0: (1073 commits) Reverting transfer parm file changes committed at 39bab45 Component tag updates for nwprod/gfsv16.0.7 Updated transfer parm files for gdas, enkf, and gfs dissemination Add config.resources.nco.static ecflow forecast job resource updates from NCO v16.0.7 install Add missing symlinks for WAFS source code folders Update EMC_gfs_wafs tag to gfs_wafs.v6.0.19 Remove KEEPDATA from config.base.nco.static Pull in config changes from NCO v16.0.7 install Pull in workflow changes from NCO v16.0.7 install Update EMC_verif-global tag to verif_global_v1.13.4 ecFlow resource adjustments from NCO for forecast and post jobs issue NOAA-EMC#257 shorten run time on Mars Dell1 file system Update Fit2Obs tag to newm.1.3 for bugfix Update EMC_verif-global tag for Hera bug Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6 move errchk definition from script to job for wave prdgen and gempak adding definition of errchk which was undefined in these scripts Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request Issue #1: update ecflow to be consistent with NCO's gfs.v16.0.4 and update checkout to bring in new UPP tag (see issue NOAA-EMC#226) Upaded ush script scale_dec.sh Updated scripts gfs_v16.0 Issue #1 - add grib_util module load to several analysis ecflow scripts Issue #1 - update WAFS tag to gfs_wafs.v6.0.17 for dbn_alert change Issue #1 - correct gridded wave parm files for v16.0.3 Issue #1 - changes from NCO for GFSv16.0.3 Issue #1 - update Externals.cfg with final tags for GFSv16.0.2 Issue #1 - correct permissions on jobs/rocoto/postsnd.sh Issue #1 - update gempak version to 7.3.3 in the ecflow gfs.ver file Issue #1 - update gempak and dumpjb versions to 7.3.3 and 5.1.0 respectively Script alert updates from NCO for wave downstream Add override for COMIN_WAV_RTOFS in emc mode for waveprep job Issue NOAA-EMC#197: place CDATE specific sections of config.anal and config.prep inside RUN_ENVIR=emc blocks. These sections are use for retrospective parallels and therefore do not need to be executed in operations (NCO). modified: JGLOBAL_FORECAST modified: JGLOBAL_FORECAST to make it work for both emc and nco running environments. modified: JGLOBAL_FORECAST A test showed that jobid is not defined in JGLOBAL_FORECAST running in the Rocoto environment. jobid is defined in ./env files. Defining DATA without sourcing ./env/$nachine.env caused the script to fail. Move the definitin of DATA after sourcing env parameters modified: checkout.sh to use WAFS tag gfs_wafs.v6.0.16 modified: checkout.sh to update UPP to upp_gfsv16_release.v1.1.1, a minor syntax bug fix modified: link_fv3gfs.sh to 1) use hard copies of external fix fields and executable for NCO installation 2) use soft links for all other files and directories for both NCO and EMC installations Compared local files in NCO implementation directory with release/gfs.v16.0.0 branch, changes made by NCO(Jen Yang) in the following files are either accepted or rejected. create a new branch release/gfsv16.0.0.nco to merge changes made by NCO in /gpfs/dell1/nco/ops/nwpara/gfs-v16/gfs.v16.0.1 back to EMC's repository update for the wave parm so that the wave model will look for the correct restart for when gfs is not run every cycle updates for checking if RTOFS files exist and only processing RTOFS files for needed fhr Issue #1 - update WAFS tag to gfs_wafs.v6.0.14 and update dumpjb version to 5.1.0 modified: jobs/JGFS_ATMOS_POSTSND and jobs/rocoto/postsnd.sh to remove redundant variables in the two scripts and make them work for both EMC and NCO parallels. Issue #1 - update WAFS tag to gfs_wafs.v6.0.13 Rename Release_Notes.gfs.v16.0.0.txt to Release_Notes.gfs.v16.0.0.md Issue #1 - update WAFS tag to gfs_wafs.v6.0.12 for removal of in-cloud turbulence per AWC Issue #1 - pull in corrected npe_eobs values in config.resources Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support Issue #1 - adjust WAFS dependencies to wait for f036 post output Issue #1 - adding release notes for GFSv16 Issue NOAA-EMC#94 producing awips files with masks and deleting wmo headers for arctic ocean updates to add glo_30m to the created grib files for waves for awips processing Modify gfs/gdas post job to 20 minutes in wall clock. Issue #1 - update link_fv3gfs.sh to point to newly frozen fix_nco_gfsv16 FIX_DIR Modify two wafs jobs trigger as: jgfs_atmos_wafs_grib2 trigger ../../post/jgfs_atmos_post_f000 == complete jgfs_atmos_wafs_grib2_0p25 trigger ../../post/jgfs_atmos_post_f036 == complete Issue #1 - update WAFS tag to gfs_wafs.v6.0.10 and change WAFS job dependencies Issue #1 - update config.fv3 and config.resources with v16rt2 values Issue #1 - update gfs_util modulefiles Change config.resources for eobs for low resolution cases Issue #1 - update to fbwndgfs modulefiles for WCOSS-Dell and WCOSS-Cray updates to parm to reduce the number of wave variables changes to the config so that wave models are interpolated to the multi_1 masked files for the regional output grids Modify module for each job to match implementation package change Modify two wafs jobs trigger Modify wall clock and resource for running jobs in NCO Modify obsproc package location add a dependency for the wavepostpnt on wavepostbndpnt for just gfs as this job does not exist for gdas Issue #1 - update WAFS tag to gfs_wafs.v6.0.9 Issue #1 - remove POE/BACK block from config.prep and set POE=YES/BACK=off as defaults in env/WCOSS_DELL_P3.env prep section Issue #1 - remove unneeded DMPDIR and ICSDIR from config.base.nco.static for rocoto add a dependency to wavepostpnt job on wavepostbndpnt so that both jobs will not run at the same time which will slow both jobs down. This is the reason for the dependency, otherwise there is not a "true" dependency between the jobs Issue #1 - return POE=YES and BACK=off setting for prep on WCOSS_DELL_P3 Issue #1 - remove hardcoded POE and BACK values from config.prep Issue #1 - move ABIBF, AHIBF, and HDOB pointers into RUN_ENVIR=emc block Issue #1 - update config.fv3 based on real-time parallel Issue #1 - update prep job resources Issue #1 - update g2tmpl module load in modulefiles/module_base.wcoss_dell_p3 Issue #1 - config updates from real-time parallel Issue #1 - remove unneeded line in vrfy.sh and update link_fv3gfs.sh for UFS_UTILS execs Issue #1 - update GSI tag to gfsda.v16.0.0 Issue #1 - update component tags and modulefiles for nwtest lib updates, remove unneeded module load and modulefile from downstream wave job rocoto scripts Issue #1 - adjust error handling in wave rocoto job scripts issue NOAA-EMC#142 generate station i,j grid issue NOAA-EMC#142 generate station i,j grid issue NOAA-EMC#142 generate station i,j grid issue NOAA-EMC#142 add 6 bufr station data issue NOAA-EMC#142 add 6 bufr stations for Thailand TMD issue NOAA-EMC#145 change dev path to prod for parallel netcdf modules issue NOAA-EMC#145 change dev path to prod for parallel netcdf modules Issue #1 - updates for modules and small fixes reverting changes to configs that were not intented to be committed fix resource time estimates bug fix in exgfs_wave_post_pnt.sh update resources and trigger from 192->180 last of EE2 changes updates for EE2 from waves Issue NOAA-EMC#94 fix for failing silently Issue #1 - update WAFS tag to gfs_wafs.v6.0.8 Issue NOAA-EMC#94 add native grids as default grids Issue #1: update name of ncdiag executable and source code directory to be conistent cleaning up the rearranged scripts Jobs were tested with PDY 20200925, code managers from post, gempak, wave, and post process certified the test run result. Issue #1: update parm/config.vrfy to define VSDBJOBSH (used by jobs/rocoto/vrfy.sh) Code manager indicated all wafs jobs wall clock is 30 mins. Code manager indicated job card for scripts/gfs/atmos/gempak/jgfs_atmos_pgrb2_spec_gempak.ecf need to be changed The EMC realtime parallel does not use operational job settings. Ecflow job card roll back the setting from module_used_gfs-16_job google sheet document. Update GLDAS tag to gldas_gfsv16_release.v1.10.0 Update gfswafs job to run with loop over fcsthrs Issue #1: update vrfy.sh to submit vsdb processing as separate job (only on WCOSS_DELL_P3) Issue NOAA-EMC#94 add /fakedbn to run DBN_alerts Update config.awips for newly named JJOB scripts Update WAFS jobs/rocoto scripts to use new JJOB names Making J-Job naming change accourding to code manager. Remove temp files Update post.sh UPP JJOB script name to submit Modify each ecflow script with old j-job name for test. Update config.base.nco.static with config.base.emc.dyn changes Script name updates for sfc_prep and tracker Name change for tropcy scripts and update WAFS tag Fixing spelling mistake in config.gldas Updated drivers and release notes Updated scripts Update Externals.cfg with new UPP tag upp_gfsv16_release.v1.0.16. 1)Update sorc/checkout.sh with new UPP tag upp_gfsv16_release.v1.0.16. 2)Update sorc/link_fv3gfs.sh with new file name convention for jjob and ex-script of post processing part. Updated jobs name Update EMC_verif-global tag to verif_global_v1.11.0 Rename scripts to match ecf script naming convention. Add SENDDBN and DBNROOT. Update GLDAS tag. In anticipating changes from the GLDAS repo : renaming JGDAS_GLDAS to JGDAS_ATMOS_GLDAS, and exgdas_gldas.sh to exgdas_atmos_gldas.sh renamed: jobs/JGFS_POSTSND -> jobs/JGFS_ATMOS_POSTSND renamed: scripts/exgfs_postsnd.sh -> scripts/exgfs_atmos_postsnd.sh modified: docs/archive/README_bufr driver/product/run_postsnd.sh driver/product/run_postsnd.sh.cray driver/product/run_postsnd.sh.dell driver/product/run_postsnd.sh.hera driver/product/run_postsnd.sh.jet parm/config/config.postsnd renamed: scripts/exglobal_fcst_nemsfv3gfs.sh -> scripts/exglobal_forecast.sh and modified jobs/JGLOBAL_FORECAST parm/config/config.fcst updates for optimizing point jobs Issue #1 - update SEND variables and add DBNROOT to base configs and add check to build_enkf_chgres_recenter_nc.sh for GSI build Issue #1 - update to UFS_UTILS ops-gfsv16.0.0 tag Issue #1 - fix to link_fv3gfs.sh for new GLDAS tag Issue NOAA-EMC#131 Unify dbn_alert path Issue #1: update to UPP tag "upp_gfsv16_release.v1.0.15" Fix for running prep on Hera ecflow full day cycle included Update WAFS tag to gfs_wafs.v6.0.6 Small updates: - new UPP tag - new GLDAS tag - new WAFS tag - new module for WAFS - EE2 updates to awips scripts - added WAFS to archival - break downstream and WAFS archival into separate gfs_downstream tarball - update gfsarch dependencies to wait for all wavepost jobs to complete Issue NOAA-EMC#131 reduce scripts output to logfile Issue NOAA-EMC#131 added a path to DBNROOT Adding wafs wave and downstream jobs updates for by hour post Issue #1: add fhrgrp and fhrlst back to gfsawips in setup_workflow.py (bugfix) adding the line to go back a day for RTOFS for the if not NCO section because RTOFS will not be available until 06 cycle Restructured ecflow - up to post step deleted relocate_mv_nvortex.fd since storm relocation is no longer needed. modified build_tropcy_NEMS.sh to remove references to relocate_mv_nvortex Issue #1: correct DA typos in sorc/link_fv3gfs.sh Increase walltime for new wavepost jobs Issue #1: update name of DA jobs and scripts in accordance with WCOSS Implementation Standards Issue NOAA-EMC#94 add waves-prdgen, ICE->ICEC, Sleep in gempak script add gfs gempak downstream jobs into def file worked on wcoss ecflow script rename after redesign approved - not including all wave jobs Issue #1: clean up DA sections of link_fv3gfs.sh fix from Bhavani for having first wave grib file be set as a forecast instead of analysis fix from Bhavani for having first wave grib file be set as a forecast instead of analysis fix from Bhavani for having first wave grib file be set as a forecast instead of analysis ecflow gfs v16 nco review 3 updates to split boundary points plus saving config file updates Adding missing space to if-block in env files to resolve runtime failure Issue #1: remove pgrb2b.0p25 dependency from gfsawips in setup_workflow.py ecflow gfsv16 redesign 2 Issue #1 - update WAFS tag to gfs_wafs.v6.0.4 and remove HOURLY variable from WAFS configs Issue #1 - change wavegempak and waveawipsgridded dependency to match waveawipsbulls and start when wavepostsbs is complete Issue #1: set n_sponge=42 in gfs section of config.fcst adding pnt jobs as seperate jobs for env moving definitions of wavempexec and wave_mpmd from jobs to env Remove unneeded settings from config.post Added null DBNROOT to wave awips configs add extra script for by hour points for waves updates for boundary points by hour parallelization lowering the resource requirement for wave prep job Issue #1: rename enkf_chgres_recenter executables in accordance with WCOSS Implementation Standards modified: checkout.sh to use gldas_gfsv16_release.v1.6.0 update module for cdo Update to WAFS tag and added SENDDBN_NTC to both base configs modified: link_fv3gfs.sh to not link or copy 0readme fix_chem fix_fv3 fix_sfc_climo which are not used by GFS.v16 and are of large size modified: link_fv3gfs.sh to remove chgres_cube.fd and chgres_cube.fd in sorc/link_fv3gfs.sh modified: link_fv3gfs.sh to allow "fix" directories to be removed before rerunning link_fv3gfs.sh for RUN_ENVIR=nco case Added WAFS jobs to free-forecast mode, updates for extending WAFS to fh120, and two bug fixes in link_fv3gfs.sh and hpssarch_gen.sh Renamed global-workflow-owned ex-scripts to remove ecf extension and updated other scripts which call those ex-scripts Remove UFS_UTILS ecf extensions Issue #1: (1) update earc.sh directory removal to be consistent with arch.sh, (2) update config files to be consistent with EMC real-time GFS v16 parallel Remove ecf script name extensions from downstream wave scripts Add new downstream wave jobs to workflow Add new downstream WAFS jobs Issue #1 - update GLDAS and UPP workflow files for removal of ecf script extension Issue #1: remove ".ecf" suffix from DA scripts referenced in sorc/link_fv3gfs.sh Issue #1: remove ".ecf" extension from DA exscripts (as per WCOSS Implementation Standards) referenced from parm/config files updates to resources for wave jobs Issue #1: update name of DA enkf chgres script in config.echgres Issue #1: Rename DA enkf chgres job and script as per EE2 guidance Workflow changes for wave gempak and awips downstream jobs Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py ... * conflicts resolved Refs: #1
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
Merge remote-tracking branch 'origin/release/gfsv16.0.0' into release/gfsv16.0.0_to_ops * origin/release/gfsv16.0.0: Fix cycle date in bull and cbull wave files Refs: #1
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
Tag updates: 1. Change WAFS 1.25 products (except for icing & turbulence) on model pressure levels. 2. Add CAT and MWT back to 0.25 WAFS product Refs: #1
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
Will retain in other release branch. Removing to keep continuity with nwprod for GFSv16 post-implementation fix updates. Refs: #1
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 6, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Apr 14, 2021
- Remove wavepostbndpntbll trigger from prod def file for each cycle Refs: #1
lgannoaa
pushed a commit
that referenced
this pull request
May 27, 2021
…/issue238 * origin/release/gfsv16.0.0: Add missing symlinks for WAFS source code folders Update EMC_gfs_wafs tag to gfs_wafs.v6.0.19 Refs: #1,NOAA-EMC#238
lgannoaa
pushed a commit
that referenced
this pull request
May 27, 2021
* upstream/develop: remove flags that were not present in Makefiles update jasper to 2.x.25. remove compiler flag in fv3nc2nemsio Update EMC_verif-global tag to verif_global_v1.13.4 another use of _d where an _4 is needed Adjust how target is set for build_workflow_utils Add workflow_utils to build_all and link scripts copy/paste error from enkf_chgres_recenter.fd to enkf_chgres_recenter_nc.fd. When going from nemsio to netcdf, the linking of ip, sp and w3nco changed from _d to _4. update .gitignore to exclude build and install directories as well as compiled files. bugfix in build_workflow_utils.sh hack. nceplibs-ncio now creates the module ncio and not fv3gfs_ncio. add cmake build capability for workflow utilities Update Fit2Obs tag to newm.1.3 for bugfix Update Fit2Obs tag to newm.1.3 for bugfix Update EMC_verif-global tag for Hera bug Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl HOTFIX: Update EMC_verif-global tag for Hera bug Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6 move errchk definition from script to job for wave prdgen and gempak adding definition of errchk which was undefined in these scripts Issue NOAA-EMC#179 and issue NOAA-EMC#243 - update Fit2Obs to newm.1.2 tag and correct COMROOT path for Hera HOTFIX: Issue NOAA-EMC#241 - update EMC_verif-global tag to remove use of /tmp space Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs Issue NOAA-EMC#179 - update to config.vrfy for Fit2Obs tag which supports Orion Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 Issue NOAA-EMC#233 - remove unnecessary extra space in tag line for gldas Issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert modified: exglobal_forecast.sh The breakpoint restart only works for the first restart from a breakpoint. Restart files written in RERUN_RESTRAT after the first restart has a 3-hour time shift for DO_IAU=YES cases. Forecasts starting from the 2nd breakpoint and beyond will fail becasue of incorrect initial conditins. This commit fixes this bug. issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request Issue #1: update ecflow to be consistent with NCO's gfs.v16.0.4 and update checkout to bring in new UPP tag (see issue NOAA-EMC#226) Upaded ush script scale_dec.sh Updated scripts gfs_v16.0 Issue #1 and issue NOAA-EMC#220 - set C192/C96/C48 npe_eobs back to dev values for develop Issue #1 - add grib_util module load to several analysis ecflow scripts Issue NOAA-EMC#189 - update ufs-weather-model hash Issue NOAA-EMC#201 - workaround for failing post000 job before hpc-stack solution Issue #1 - update WAFS tag to gfs_wafs.v6.0.17 for dbn_alert change Issue #1 - correct gridded wave parm files for v16.0.3 Issue #1 - changes from NCO for GFSv16.0.3 Issue #1 - update Externals.cfg with final tags for GFSv16.0.2 Fixes for issue NOAA-EMC#202 (FINDDATE) and issue NOAA-EMC#208 (postsnd.sh permissions) Issue #1 - correct permissions on jobs/rocoto/postsnd.sh Issue #1 - update gempak version to 7.3.3 in the ecflow gfs.ver file Issue #1 - update gempak and dumpjb versions to 7.3.3 and 5.1.0 respectively Script alert updates from NCO for wave downstream Add override for COMIN_WAV_RTOFS in emc mode for waveprep job Issue NOAA-EMC#197: place CDATE specific sections of config.anal and config.prep inside RUN_ENVIR=emc blocks. These sections are use for retrospective parallels and therefore do not need to be executed in operations (NCO). modified: JGLOBAL_FORECAST modified: JGLOBAL_FORECAST to make it work for both emc and nco running environments. modified: JGLOBAL_FORECAST A test showed that jobid is not defined in JGLOBAL_FORECAST running in the Rocoto environment. jobid is defined in ./env files. Defining DATA without sourcing ./env/$nachine.env caused the script to fail. Move the definitin of DATA after sourcing env parameters modified: checkout.sh to use WAFS tag gfs_wafs.v6.0.16 modified: checkout.sh to update UPP to upp_gfsv16_release.v1.1.1, a minor syntax bug fix modified: link_fv3gfs.sh to 1) use hard copies of external fix fields and executable for NCO installation 2) use soft links for all other files and directories for both NCO and EMC installations Compared local files in NCO implementation directory with release/gfs.v16.0.0 branch, changes made by NCO(Jen Yang) in the following files are either accepted or rejected. create a new branch release/gfsv16.0.0.nco to merge changes made by NCO in /gpfs/dell1/nco/ops/nwpara/gfs-v16/gfs.v16.0.1 back to EMC's repository update for the wave parm so that the wave model will look for the correct restart for when gfs is not run every cycle updates for checking if RTOFS files exist and only processing RTOFS files for needed fhr
lgannoaa
pushed a commit
that referenced
this pull request
May 27, 2021
- wave footer fix comes via a new util_shared module version on WCOSS - update module version to 1.3.0 in module_base.wcoss_dell_p3 and gfs.ver Refs: #1, NOAA-EMC#309
lgannoaa
pushed a commit
that referenced
this pull request
May 27, 2021
lgannoaa
pushed a commit
that referenced
this pull request
May 27, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Jul 26, 2021
Update free-forecast mode to interface with UFS_UTILS gdas_init utility scripts. Update getic job to use gdas_init get scripts to pull ICs off HPSS for GFS versions 13 and later. Rename fv3ic job to "init" and update it to interface with gdas_init run scripts to run chgres_cube and produce GFSv16 ICs. Update job dependencies to detect need to run chgres jobs and hold forecast jobs until ICs are generated or present. Further updates coming for this task. Tested on WCOSS-Dell, need to test elsewhere still. Will disable getic job on Orion. Refs: #1, NOAA-EMC#178
lgannoaa
pushed a commit
that referenced
this pull request
Jul 26, 2021
* upstream/develop: Update Fit2Obs tag to newm.1.3 for bugfix Update Fit2Obs tag to newm.1.3 for bugfix Update EMC_verif-global tag for Hera bug Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl HOTFIX: Update EMC_verif-global tag for Hera bug Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6 move errchk definition from script to job for wave prdgen and gempak adding definition of errchk which was undefined in these scripts Issue NOAA-EMC#179 and issue NOAA-EMC#243 - update Fit2Obs to newm.1.2 tag and correct COMROOT path for Hera HOTFIX: Issue NOAA-EMC#241 - update EMC_verif-global tag to remove use of /tmp space Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs Issue NOAA-EMC#179 - update to config.vrfy for Fit2Obs tag which supports Orion Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 Issue NOAA-EMC#233 - remove unnecessary extra space in tag line for gldas Issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request Issue #1: update ecflow to be consistent with NCO's gfs.v16.0.4 and update checkout to bring in new UPP tag (see issue NOAA-EMC#226) Upaded ush script scale_dec.sh Updated scripts gfs_v16.0 Refs: NOAA-EMC#178
lgannoaa
pushed a commit
that referenced
this pull request
Jul 26, 2021
* origin/develop: remove flags that were not present in Makefiles update jasper to 2.x.25. remove compiler flag in fv3nc2nemsio Update EMC_verif-global tag to verif_global_v1.13.4 another use of _d where an _4 is needed Adjust how target is set for build_workflow_utils Add workflow_utils to build_all and link scripts copy/paste error from enkf_chgres_recenter.fd to enkf_chgres_recenter_nc.fd. When going from nemsio to netcdf, the linking of ip, sp and w3nco changed from _d to _4. update .gitignore to exclude build and install directories as well as compiled files. bugfix in build_workflow_utils.sh hack. nceplibs-ncio now creates the module ncio and not fv3gfs_ncio. add cmake build capability for workflow utilities Update Fit2Obs tag to newm.1.3 for bugfix Update Fit2Obs tag to newm.1.3 for bugfix Update EMC_verif-global tag for Hera bug Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl HOTFIX: Update EMC_verif-global tag for Hera bug Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6 move errchk definition from script to job for wave prdgen and gempak adding definition of errchk which was undefined in these scripts Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request Issue #1: update ecflow to be consistent with NCO's gfs.v16.0.4 and update checkout to bring in new UPP tag (see issue NOAA-EMC#226) Upaded ush script scale_dec.sh Updated scripts gfs_v16.0 Conflicts: Externals.cfg sorc/checkout.sh Refs: NOAA-EMC#164
lgannoaa
pushed a commit
that referenced
this pull request
Dec 27, 2021
lgannoaa
pushed a commit
that referenced
this pull request
Feb 9, 2022
* Initial spack/cmake version * updated for umbrella build * tweak to findnetcdf * added include directory * updated cmake * changed to https for cmake submodule * updated cmake submodule * updated install directory * added build for libnceppost.a * modifications for macOS clang/gfortran build * updated for gnu build * udpated cmake submodule * Add RST file for UPP v4.0 * Modifying introduction * merged develop in and separated library from executable in build * Update CMakeLists.txt files to support GNU compilers * applied patch from Dusan * Add conf.py for upp documentation * Add index.rst for upp documentation * Add readthedocs config file * Modify name of main rst doc in index for readthedocs build test * Change master file to index * Edits for UFS documentation to remove WRF and grib1 references * Add a readthedocs config file * Mods to config and index files for use in readthedocs * Update submodule pointer for cmake * Remove old GNU makefiles with problematic names (only differing in case from existing files) * Add files for GRIB2 table of fields * Update .gitmodules, add branch = ufs_release_1.0 for cmake * Update .gitmodules for testing, code review and merging * Update include/lib flags for sigio, sfcio, nemsio * Add REQUIRED attribute to find_package calls in CMakeLists.txt * Comment out LAPACK dependency in CMakeLists.txt * Revert change to .gitmodules, update submodule pointer for cmake * sorc/ncep_post.fd/CMakeLists.txt: change GFSIO_INC to GFSIO_INC4 * Add capacity of detecting scaning mode north2south vs south2north in gaussian grid from Dusan. * Re-factor CMake * Fix library linking * small fix to kyles refactor * Add capacity of detecting scaning mode north2south vs south2north in gaussian grid from Dusan. * Fix typo in sorc/ncep_post.fd/CMakeLists.txt * Fix how Intel compile options with spaces in them are handled * Update branch name for cmake submodule, update submodule pointer * Update submodule pointer for cmake * Update .gitmodules and submodule pointer for cmake, bugfixes for CMakeLists.txt * Update submodule pointer for cmake * fixes problem linking ncep_post with gnu/openmpi * Update submodule pointer for cmake * Revert .gitmodules change * Bugfix: comment out debug print statement that can lead to out-of-bounds access; update submodule pointer for cmake * Update submodule pointer for cmake * OpenMP bugfix, use lowercase in find_package(CRTM) * Fix post crash on macOS: use allocatable array * Update submodule pointer for cmake * Add UFS UPP rst documentation * Update submodule pointer for cmake * Rename g2tmpl_d to g2tmpl (NOAA-EMC#89) * Update submodule pointer for cmake * cleanup post Change-Id: Ie52af5ff79ac4122e79d7a46e89ee2077188b0a4 * we dont depend on C HDF5 library. remove. Change-Id: I26aa7c0bf7ed2783de1a9967d961d0260dee8b54 * use transitive properties. apply OpenMP flags if OpenMP is found. Formatting using cmake-format Change-Id: Ic08ce6bc85a7d949c779ec597241c8cb4c20db86 * add debug gnu flags. compile_definitions does not like the quotes around long long, remove Change-Id: Iccd5bb496944f75a79500729051dd571303cb50f * Update CMakeLists.txt * Update submodule pointer for cmake * Update submodule pointer for cmake * Add LGPL license to repository * EMC_post is a Fortran only project. blockIO.c is not used, so do not include in building * Update submodule pointer for cmake * Bug fix for unary operator in INITPOST_GFS_NEMS_MPIIO.f. (NOAA-EMC#92) * Remove old unused makefiles * CMakeLists.txt: install postxconfig-NT-GFS-F00.txt and postxconfig-NT-GFS.txt in share directory * Update version @fossell says post is at version 8.0.0 * Update submodule pointer for cmake * Fix Out of Bound Exception in GFSPOST.F (NOAA-EMC#100) * Fix out-of-bound error in tpause routine in GFSPOST.F * Fix use of undefined variables. * Feature/cleanup (NOAA-EMC#95) * cleanup post Change-Id: Ie52af5ff79ac4122e79d7a46e89ee2077188b0a4 * we dont depend on C HDF5 library. remove. Change-Id: I26aa7c0bf7ed2783de1a9967d961d0260dee8b54 * use transitive properties. apply OpenMP flags if OpenMP is found. Formatting using cmake-format Change-Id: Ic08ce6bc85a7d949c779ec597241c8cb4c20db86 * add debug gnu flags. compile_definitions does not like the quotes around long long, remove Change-Id: Iccd5bb496944f75a79500729051dd571303cb50f * Update CMakeLists.txt * EMC_post is a Fortran only project. blockIO.c is not used, so do not include in building * Update version @fossell says post is at version 8.0.0 * Revert "Feature/cleanup (NOAA-EMC#95)" This reverts commit 7e9797b355d2b86ea9e274534f86adc42e866b95. * remove unused compile definitions and update cmake pointer Change-Id: Ie47cf16ebc25928bf30bfd05d4f25678219571a6 * Fix ID index in WRF-CHEM SMOKE block, which currently causes failed build in debug mode * remove unnecessary commented line * NetCDF static fix (#1) * CMakeLists.txt: add MODULE to find_package calls * Cleanup of NetCDF in CMakeLists.txt * update cmake submodule pointer Change-Id: I763882fd6ecc4b8cc64a60eddabccfdb7046040d * Add MODULE to find_package(NetCDF) call (NOAA-EMC#3) * update cmake submodule pointer Change-Id: I69015efa425658645567e9d9f22d5e51301c1a0b * Change version from 8.0.0 to 1.0.0 * fix the install path of compiled Fortran module files Co-authored-by: Mark A Potts <mark.potts@noaa.gov> Co-authored-by: Dom Heinzeller <climbfuji@ymail.com> Co-authored-by: Mark Potts <33099090+mark-a-potts@users.noreply.github.com> Co-authored-by: Tracy <hertneky@ucar.edu> Co-authored-by: Kate Fossell <fossell@ucar.edu> Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov> Co-authored-by: Wen Meng <wen.meng@noaa.gov> Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com> Co-authored-by: Kyle Gerheiser <kgerheiser@icloud.com> Co-authored-by: Mark Potts <mpotts@redlineperf.com> Co-authored-by: Kyle Gerheiser <3209794+kgerheiser@users.noreply.github.com> Co-authored-by: Dom Heinzeller <dom.heinzeller@noaa.gov> Co-authored-by: Tracy <tracy.hertneky@noaa.gov> Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com> Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com> Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add "comroot" setting to Orion if-block in setup scripts and removed unneeded additional COMINsyn and COMROOT settings in configs.