Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix missing COMROOT setting for Orion #1

Merged
merged 1 commit into from
Nov 16, 2020

Conversation

KateFriedman-NOAA
Copy link

Add "comroot" setting to Orion if-block in setup scripts and removed unneeded additional COMINsyn and COMROOT settings in configs.

@lgannoaa lgannoaa merged commit 66cc1a0 into lgannoaa:feature/ccpp Nov 16, 2020
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
* jobs/rocoto/ecen.sh - remove FHSFC_ECEN

* ush/rocoto/setup_workflow.py - remove fhrsfc and associated scripting
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
 (1) provide default defintion for CONVNETC

 (2) update WCOSS_DELL_P3 fitdir
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
   to save sfcanl for running gldas as ICs
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
lgannoaa pushed a commit that referenced this pull request Jan 22, 2021
Merge branch 'develop' at revision 3ed9267 into feature/gfsv16b
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- ecflow forecast scripts changes for resources
- fixes to prdgen wave scripts

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- add line to config.fcst to allow running gdas and gfs with different threading
- add nth_fv3_gfs to config.fv3 to support different threading for gfs
- changes to post settings in config.resources to make post use all tasks on a node
and speed up post jobs

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- NCO requested that KEEPDATA be removed from config.base and config.fcst since
KEEPDATA gets set at the ecflow level and shouldn't be changed by the configs lower down.
- Already commented out in config.fcst in prior commit.
- Removed KEEPDATA from config.base.nco.static since it becomes config.base
in prod mode with ecflow.
- Retaining KEEPDATA in config.base.emc.dyn since that only becomes config.base
in dev mode (rocoto doesn't set KEEPDATA).

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- new tag includes changes made locally in NCO nwpara/gfsv16.0.7 install

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- added symlinks in link_fv3gfs.sh for wafs_blending_0p25.fd and wafs_grib2_0p25.fd

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- added parm/config/config.resources.nco.static; contains resources for operations
- added copy of config.resources.nco.static in link_fv3gfs.sh when nco mode

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- Final nwprod implementation component tag versions set in Externals.cfg and checkout.sh
- GLDAS: roll back to gldas_gfsv16_release.v1.12.0
- EMC_verif-global: roll back to verif_global_v1.11.0
- WAFS: update in Externals.cfg to gfs_wafs.v6.0.19

Notes about local nwprod install changes:

- EMC_post: nwprod install shows upp_gfsv16_release.v1.1.1 tag but contains
local updates found in upp_gfsv16_release.v1.1.3 tag
- WAFS: nwprod install shows gfs_wafs.v6.0.17 tag but contains local updates
found in gfs_wafs.v6.0.19 tag

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
- updates to the transfer parm files were erroneously committed after a diff
between nwpara/gfsv16.0.7 and release/gfsv16.0.0 branch; v16.0.7 had been moved
to nwprod/gfsv16.0.7 and transfer parm file diffs were not in final install
- confirmed with SPA Jen that nwprod/gfsv16.0.7 is finalized (it is)
- pulled in transfer parm files from nwprod/gfsv16.0.7 to sync them again

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
Merge remote-tracking branch 'origin/release/gfsv16.0.0' into release/gfsv16.0.0_to_ops

* origin/release/gfsv16.0.0: (1073 commits)
  Reverting transfer parm file changes committed at 39bab45
  Component tag updates for nwprod/gfsv16.0.7
  Updated transfer parm files for gdas, enkf, and gfs dissemination
  Add config.resources.nco.static
  ecflow forecast job resource updates from NCO v16.0.7 install
  Add missing symlinks for WAFS source code folders
  Update EMC_gfs_wafs tag to gfs_wafs.v6.0.19
  Remove KEEPDATA from config.base.nco.static
  Pull in config changes from NCO v16.0.7 install
  Pull in workflow changes from NCO v16.0.7 install
  Update EMC_verif-global tag to verif_global_v1.13.4
  ecFlow resource adjustments from NCO for forecast and post jobs
  issue NOAA-EMC#257 shorten run time on Mars Dell1 file system
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update EMC_verif-global tag for Hera bug
  Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl
  Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6
  move errchk definition from script to job for wave prdgen and gempak
  adding definition of errchk which was undefined in these scripts
  Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag
  Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3
  Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  Issue #1:  update ecflow to be consistent with NCO's gfs.v16.0.4 and            update checkout to bring in new UPP tag (see issue NOAA-EMC#226)
  Upaded ush script scale_dec.sh
  Updated scripts gfs_v16.0
  Issue #1 - add grib_util module load to several analysis ecflow scripts
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.17 for dbn_alert change
  Issue #1 - correct gridded wave parm files for v16.0.3
  Issue #1 - changes from NCO for GFSv16.0.3
  Issue #1 - update Externals.cfg with final tags for GFSv16.0.2
  Issue #1 - correct permissions on jobs/rocoto/postsnd.sh
  Issue #1 - update gempak version to 7.3.3 in the ecflow gfs.ver file
  Issue #1 - update gempak and dumpjb versions to 7.3.3 and 5.1.0 respectively
  Script alert updates from NCO for wave downstream
  Add override for COMIN_WAV_RTOFS in emc mode for waveprep job
  Issue NOAA-EMC#197:  place CDATE specific sections of config.anal and config.prep inside RUN_ENVIR=emc blocks.              These sections are use for retrospective parallels and therefore do not need to be              executed in operations (NCO).
  modified:   JGLOBAL_FORECAST
  modified:   JGLOBAL_FORECAST to make it work for both emc and nco running environments.
  modified:   JGLOBAL_FORECAST A test showed that jobid is not defined in JGLOBAL_FORECAST running in the Rocoto environment. jobid is defined in ./env files. Defining DATA without sourcing ./env/$nachine.env caused the script to fail.  Move the definitin of DATA after sourcing env parameters
  modified:   checkout.sh to use WAFS tag gfs_wafs.v6.0.16
  modified:   checkout.sh to update UPP to  upp_gfsv16_release.v1.1.1, a minor syntax bug fix
  modified:   link_fv3gfs.sh to 1) use hard copies of external fix fields and executable for NCO installation 2) use soft links for all other files and directories for both NCO and EMC installations
  Compared local files in NCO implementation directory with release/gfs.v16.0.0 branch, changes made by NCO(Jen Yang) in the following files are either accepted or rejected.
  create a new branch release/gfsv16.0.0.nco to merge changes made by NCO in /gpfs/dell1/nco/ops/nwpara/gfs-v16/gfs.v16.0.1 back to EMC's repository
  update for the wave parm so that the wave model will look for the correct restart for when gfs is not run every cycle
  updates for checking if RTOFS files exist and only processing RTOFS files for needed fhr
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.14 and update dumpjb version to 5.1.0
  modified:   jobs/JGFS_ATMOS_POSTSND and jobs/rocoto/postsnd.sh to             remove redundant variables in the two scripts and make them             work for both EMC and NCO parallels.
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.13
  Rename Release_Notes.gfs.v16.0.0.txt to Release_Notes.gfs.v16.0.0.md
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.12 for removal of in-cloud turbulence per AWC
  Issue #1 - pull in corrected npe_eobs values in config.resources
  Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support
  Issue #1 - adjust WAFS dependencies to wait for f036 post output
  Issue #1 - adding release notes for GFSv16
  Issue NOAA-EMC#94 producing awips files with masks and deleting wmo headers for arctic ocean
  updates to add glo_30m to the created grib files for waves for awips processing
  Modify gfs/gdas post job to 20 minutes in wall clock.
  Issue #1 - update link_fv3gfs.sh to point to newly frozen fix_nco_gfsv16 FIX_DIR
  Modify two wafs jobs trigger as:   jgfs_atmos_wafs_grib2          trigger ../../post/jgfs_atmos_post_f000 == complete   jgfs_atmos_wafs_grib2_0p25     trigger ../../post/jgfs_atmos_post_f036 == complete
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.10 and change WAFS job dependencies
  Issue #1 - update config.fv3 and config.resources with v16rt2 values
  Issue #1 - update gfs_util modulefiles
  Change config.resources for eobs for low resolution cases
  Issue #1 - update to fbwndgfs modulefiles for WCOSS-Dell and WCOSS-Cray
  updates to parm to reduce the number of wave variables changes to the config so that wave models are interpolated to the multi_1 masked files for the regional output grids
  Modify module for each job to match implementation package change Modify two wafs jobs trigger Modify wall clock and resource for running jobs in NCO Modify obsproc package location
  add a dependency for the wavepostpnt on wavepostbndpnt for just gfs as this job does not exist for gdas
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.9
  Issue #1 - remove POE/BACK block from config.prep and set POE=YES/BACK=off as defaults in env/WCOSS_DELL_P3.env prep section
  Issue #1 - remove unneeded DMPDIR and ICSDIR from config.base.nco.static
  for rocoto add a dependency to wavepostpnt job on wavepostbndpnt so that both jobs will not run at the same time which will slow both jobs down. This is the reason for the dependency, otherwise there is not a "true" dependency between the jobs
  Issue #1 - return POE=YES and BACK=off setting for prep on WCOSS_DELL_P3
  Issue #1 - remove hardcoded POE and BACK values from config.prep
  Issue #1 - move ABIBF, AHIBF, and HDOB pointers into RUN_ENVIR=emc block
  Issue #1 - update config.fv3 based on real-time parallel
  Issue #1 - update prep job resources
  Issue #1 - update g2tmpl module load in modulefiles/module_base.wcoss_dell_p3
  Issue #1 - config updates from real-time parallel
  Issue #1 - remove unneeded line in vrfy.sh and update link_fv3gfs.sh for UFS_UTILS execs
  Issue #1 - update GSI tag to gfsda.v16.0.0
  Issue #1 - update component tags and modulefiles for nwtest lib updates, remove unneeded module load and modulefile from downstream wave job rocoto scripts
  Issue #1 - adjust error handling in wave rocoto job scripts
  issue NOAA-EMC#142 generate station i,j grid
  issue NOAA-EMC#142 generate station i,j grid
  issue NOAA-EMC#142 generate station i,j grid
  issue NOAA-EMC#142 add 6 bufr station data
  issue NOAA-EMC#142 add 6 bufr stations for Thailand TMD
  issue NOAA-EMC#145 change dev path to prod for parallel netcdf modules
  issue NOAA-EMC#145 change dev path to prod for parallel netcdf modules
  Issue #1 - updates for modules and small fixes
  reverting changes to configs that were not intented to be committed
  fix resource time estimates
  bug fix in exgfs_wave_post_pnt.sh
  update resources and trigger from 192->180
  last of EE2 changes
  updates for EE2 from waves
  Issue NOAA-EMC#94 fix for failing silently
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.8
  Issue NOAA-EMC#94 add native grids as default grids
  Issue #1:  update name of ncdiag executable and source code directory to be conistent
  cleaning up the rearranged scripts
  Jobs were tested with PDY 20200925, code managers from post, gempak, wave, and post process certified the test run result.
  Issue #1:  update parm/config.vrfy to define VSDBJOBSH (used by jobs/rocoto/vrfy.sh)
  Code manager indicated all wafs jobs wall clock is 30 mins. Code manager indicated job card for scripts/gfs/atmos/gempak/jgfs_atmos_pgrb2_spec_gempak.ecf need to be changed
  The EMC realtime parallel does not use operational job settings. Ecflow job card roll back the setting from module_used_gfs-16_job google sheet document.
  Update GLDAS tag to gldas_gfsv16_release.v1.10.0
  Update gfswafs job to run with loop over fcsthrs
  Issue #1:  update vrfy.sh to submit vsdb processing as separate job (only on WCOSS_DELL_P3)
  Issue NOAA-EMC#94 add /fakedbn to run DBN_alerts
  Update config.awips for newly named JJOB scripts
  Update WAFS jobs/rocoto scripts to use new JJOB names
  Making J-Job naming change accourding to code manager. Remove temp files
  Update post.sh UPP JJOB script name to submit
  Modify each ecflow script with old j-job name for test.
  Update config.base.nco.static with config.base.emc.dyn changes
  Script name updates for sfc_prep and tracker
  Name change for tropcy scripts and update WAFS tag
  Fixing spelling mistake in config.gldas
  Updated drivers and release notes
  Updated scripts
  Update Externals.cfg with new UPP tag upp_gfsv16_release.v1.0.16.
  1)Update sorc/checkout.sh with new UPP tag upp_gfsv16_release.v1.0.16. 2)Update sorc/link_fv3gfs.sh with new file name convention for jjob and ex-script of post processing part.
  Updated jobs name
  Update EMC_verif-global tag to verif_global_v1.11.0
  Rename scripts to match ecf script naming convention. Add SENDDBN and DBNROOT. Update GLDAS tag.
  In anticipating changes from the GLDAS repo : renaming JGDAS_GLDAS to JGDAS_ATMOS_GLDAS, and exgdas_gldas.sh to exgdas_atmos_gldas.sh
  renamed:    jobs/JGFS_POSTSND -> jobs/JGFS_ATMOS_POSTSND  	renamed:    scripts/exgfs_postsnd.sh -> scripts/exgfs_atmos_postsnd.sh  	modified:   docs/archive/README_bufr  	            driver/product/run_postsnd.sh  	            driver/product/run_postsnd.sh.cray  	            driver/product/run_postsnd.sh.dell  	            driver/product/run_postsnd.sh.hera  	            driver/product/run_postsnd.sh.jet  	            parm/config/config.postsnd
  renamed:    scripts/exglobal_fcst_nemsfv3gfs.sh -> scripts/exglobal_forecast.sh and modified  jobs/JGLOBAL_FORECAST parm/config/config.fcst
  updates for optimizing point jobs
  Issue #1 - update SEND variables and add DBNROOT to base configs and add check to build_enkf_chgres_recenter_nc.sh for GSI build
  Issue #1 - update to UFS_UTILS ops-gfsv16.0.0 tag
  Issue #1 - fix to link_fv3gfs.sh for new GLDAS tag
  Issue NOAA-EMC#131 Unify dbn_alert path
  Issue #1:  update to UPP tag "upp_gfsv16_release.v1.0.15"
  Fix for running prep on Hera
  ecflow full day cycle included
  Update WAFS tag to gfs_wafs.v6.0.6
  Small updates: - new UPP tag - new GLDAS tag - new WAFS tag - new module for WAFS - EE2 updates to awips scripts - added WAFS to archival - break downstream and WAFS archival into separate gfs_downstream tarball - update gfsarch dependencies to wait for all wavepost jobs to complete
  Issue NOAA-EMC#131 reduce scripts output to logfile
  Issue NOAA-EMC#131 added a path to DBNROOT
  Adding wafs wave and downstream jobs
  updates for by hour post
  Issue #1:  add fhrgrp and fhrlst back to gfsawips in setup_workflow.py (bugfix)
  adding the line to go back a day for RTOFS for the if not NCO section because RTOFS will not be available until 06 cycle
  Restructured ecflow - up to post step
  deleted  relocate_mv_nvortex.fd since storm relocation is no longer needed. modified build_tropcy_NEMS.sh to remove references to relocate_mv_nvortex
  Issue #1:  correct DA typos in sorc/link_fv3gfs.sh
  Increase walltime for new wavepost jobs
  Issue #1:  update name of DA jobs and scripts in accordance with WCOSS Implementation Standards
  Issue NOAA-EMC#94 add waves-prdgen, ICE->ICEC, Sleep in gempak script
  add gfs gempak downstream jobs into def file
  worked on wcoss
  ecflow script rename after redesign approved - not including all wave jobs
  Issue #1:  clean up DA sections of link_fv3gfs.sh
  fix from Bhavani for having first wave grib file be set as a forecast instead of analysis
  fix from Bhavani for having first wave grib file be set as a forecast instead of analysis
  fix from Bhavani for having first wave grib file be set as a forecast instead of analysis
  ecflow gfs v16 nco review 3
  updates to split boundary points plus saving config file updates
  Adding missing space to if-block in env files to resolve runtime failure
  Issue #1:  remove pgrb2b.0p25 dependency from gfsawips in setup_workflow.py
  ecflow gfsv16 redesign 2
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.4 and remove HOURLY variable from WAFS configs
  Issue #1 - change wavegempak and waveawipsgridded dependency to match waveawipsbulls and start when wavepostsbs is complete
  Issue #1:  set n_sponge=42 in gfs section of config.fcst
  adding pnt jobs as seperate jobs for env
  moving definitions of wavempexec and wave_mpmd from jobs to env
  Remove unneeded settings from config.post
  Added null DBNROOT to wave awips configs
  add extra script for by hour points for waves
  updates for boundary points by hour parallelization
  lowering the resource requirement for wave prep job
  Issue #1:  rename enkf_chgres_recenter executables in accordance with WCOSS Implementation Standards
  modified:   checkout.sh to use gldas_gfsv16_release.v1.6.0
  update module for cdo
  Update to WAFS tag and added SENDDBN_NTC to both base configs
  modified:   link_fv3gfs.sh to not link or copy 0readme fix_chem fix_fv3  fix_sfc_climo which are not used by GFS.v16 and are of large size
  modified:   link_fv3gfs.sh  to remove chgres_cube.fd and chgres_cube.fd in sorc/link_fv3gfs.sh
  modified:   link_fv3gfs.sh to allow "fix" directories to be removed before rerunning             link_fv3gfs.sh for RUN_ENVIR=nco case
  Added WAFS jobs to free-forecast mode, updates for extending WAFS to fh120, and two bug fixes in link_fv3gfs.sh and hpssarch_gen.sh
  Renamed global-workflow-owned ex-scripts to remove ecf extension and updated other scripts which call those ex-scripts
  Remove UFS_UTILS ecf extensions
  Issue #1:  (1) update earc.sh directory removal to be consistent with arch.sh, (2) update config files to be consistent with EMC real-time GFS v16 parallel
  Remove ecf script name extensions from downstream wave scripts
  Add new downstream wave jobs to workflow
  Add new downstream WAFS jobs
  Issue #1 - update GLDAS and UPP workflow files for removal of ecf script extension
  Issue #1:  remove ".ecf" suffix from DA scripts referenced in sorc/link_fv3gfs.sh
  Issue #1: remove ".ecf" extension from DA exscripts (as per WCOSS Implementation Standards) referenced from parm/config files
  updates to resources for wave jobs
  Issue #1:  update name of DA enkf chgres script in config.echgres
  Issue #1:  Rename DA enkf chgres job and script as per EE2 guidance
  Workflow changes for wave gempak and awips downstream jobs
  Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py
  ...

* conflicts resolved

Refs: #1
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
Merge remote-tracking branch 'origin/release/gfsv16.0.0' into release/gfsv16.0.0_to_ops

* origin/release/gfsv16.0.0:
  Fix cycle date in bull and cbull wave files

Refs: #1
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
Tag updates:

    1. Change WAFS 1.25 products (except for icing & turbulence) on model pressure levels.
    2. Add CAT and MWT back to 0.25 WAFS product

Refs: #1
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
Will retain in other release branch. Removing to keep continuity with nwprod
for GFSv16 post-implementation fix updates.

Refs: #1
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
lgannoaa pushed a commit that referenced this pull request Apr 6, 2021
lgannoaa pushed a commit that referenced this pull request Apr 14, 2021
- Remove wavepostbndpntbll trigger from prod def file for each cycle

Refs: #1
lgannoaa pushed a commit that referenced this pull request May 27, 2021
…/issue238

* origin/release/gfsv16.0.0:
  Add missing symlinks for WAFS source code folders
  Update EMC_gfs_wafs tag to gfs_wafs.v6.0.19

Refs: #1,NOAA-EMC#238
lgannoaa pushed a commit that referenced this pull request May 27, 2021
* upstream/develop:
  remove flags that were not present in Makefiles
  update jasper to 2.x.25. remove compiler flag in fv3nc2nemsio
  Update EMC_verif-global tag to verif_global_v1.13.4
  another use of _d where an _4 is needed
  Adjust how target is set for build_workflow_utils
  Add workflow_utils to build_all and link scripts
  copy/paste error from enkf_chgres_recenter.fd to enkf_chgres_recenter_nc.fd.  When going from nemsio to netcdf, the linking of ip, sp and w3nco changed from _d to _4.
  update .gitignore to exclude build and install directories as well as compiled files. bugfix in build_workflow_utils.sh hack. nceplibs-ncio now creates the module ncio and not fv3gfs_ncio.
  add cmake build capability for workflow utilities
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update EMC_verif-global tag for Hera bug
  Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl
  HOTFIX: Update EMC_verif-global tag for Hera bug
  Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6
  move errchk definition from script to job for wave prdgen and gempak
  adding definition of errchk which was undefined in these scripts
  Issue NOAA-EMC#179 and issue NOAA-EMC#243 - update Fit2Obs to newm.1.2 tag and correct COMROOT path for Hera
  HOTFIX: Issue NOAA-EMC#241 - update EMC_verif-global tag to remove use of /tmp space
  Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag
  Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs
  Issue NOAA-EMC#179 - update to config.vrfy for Fit2Obs tag which supports Orion
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3
  Issue NOAA-EMC#233 - remove unnecessary extra space in tag line for gldas
  Issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert
  modified:   exglobal_forecast.sh The breakpoint restart only works for the first restart from a breakpoint. Restart files written in RERUN_RESTRAT after the first restart has a 3-hour time shift for DO_IAU=YES cases. Forecasts starting from the 2nd breakpoint and beyond will fail becasue of incorrect initial conditins.  This commit fixes this bug.
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  Issue #1:  update ecflow to be consistent with NCO's gfs.v16.0.4 and            update checkout to bring in new UPP tag (see issue NOAA-EMC#226)
  Upaded ush script scale_dec.sh
  Updated scripts gfs_v16.0
  Issue #1 and issue NOAA-EMC#220 - set C192/C96/C48 npe_eobs back to dev values for develop
  Issue #1 - add grib_util module load to several analysis ecflow scripts
  Issue NOAA-EMC#189 - update ufs-weather-model hash
  Issue NOAA-EMC#201 - workaround for failing post000 job before hpc-stack solution
  Issue #1 - update WAFS tag to gfs_wafs.v6.0.17 for dbn_alert change
  Issue #1 - correct gridded wave parm files for v16.0.3
  Issue #1 - changes from NCO for GFSv16.0.3
  Issue #1 - update Externals.cfg with final tags for GFSv16.0.2
  Fixes for issue NOAA-EMC#202 (FINDDATE) and issue NOAA-EMC#208 (postsnd.sh permissions)
  Issue #1 - correct permissions on jobs/rocoto/postsnd.sh
  Issue #1 - update gempak version to 7.3.3 in the ecflow gfs.ver file
  Issue #1 - update gempak and dumpjb versions to 7.3.3 and 5.1.0 respectively
  Script alert updates from NCO for wave downstream
  Add override for COMIN_WAV_RTOFS in emc mode for waveprep job
  Issue NOAA-EMC#197:  place CDATE specific sections of config.anal and config.prep inside RUN_ENVIR=emc blocks.              These sections are use for retrospective parallels and therefore do not need to be              executed in operations (NCO).
  modified:   JGLOBAL_FORECAST
  modified:   JGLOBAL_FORECAST to make it work for both emc and nco running environments.
  modified:   JGLOBAL_FORECAST A test showed that jobid is not defined in JGLOBAL_FORECAST running in the Rocoto environment. jobid is defined in ./env files. Defining DATA without sourcing ./env/$nachine.env caused the script to fail.  Move the definitin of DATA after sourcing env parameters
  modified:   checkout.sh to use WAFS tag gfs_wafs.v6.0.16
  modified:   checkout.sh to update UPP to  upp_gfsv16_release.v1.1.1, a minor syntax bug fix
  modified:   link_fv3gfs.sh to 1) use hard copies of external fix fields and executable for NCO installation 2) use soft links for all other files and directories for both NCO and EMC installations
  Compared local files in NCO implementation directory with release/gfs.v16.0.0 branch, changes made by NCO(Jen Yang) in the following files are either accepted or rejected.
  create a new branch release/gfsv16.0.0.nco to merge changes made by NCO in /gpfs/dell1/nco/ops/nwpara/gfs-v16/gfs.v16.0.1 back to EMC's repository
  update for the wave parm so that the wave model will look for the correct restart for when gfs is not run every cycle
  updates for checking if RTOFS files exist and only processing RTOFS files for needed fhr
lgannoaa pushed a commit that referenced this pull request May 27, 2021
- wave footer fix comes via a new util_shared module version on WCOSS
- update module version to 1.3.0 in module_base.wcoss_dell_p3 and gfs.ver

Refs: #1, NOAA-EMC#309
lgannoaa pushed a commit that referenced this pull request May 27, 2021
lgannoaa pushed a commit that referenced this pull request Jul 26, 2021
Update free-forecast mode to interface with UFS_UTILS
gdas_init utility scripts. Update getic job to use gdas_init get
scripts to pull ICs off HPSS for GFS versions 13 and later.
Rename fv3ic job to "init" and update it to interface with gdas_init
run scripts to run chgres_cube and produce GFSv16 ICs.

Update job dependencies to detect need to run chgres jobs and hold
forecast jobs until ICs are generated or present.

Further updates coming for this task. Tested on WCOSS-Dell, need to
test elsewhere still. Will disable getic job on Orion.

Refs: #1, NOAA-EMC#178
lgannoaa pushed a commit that referenced this pull request Jul 26, 2021
* upstream/develop:
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update EMC_verif-global tag for Hera bug
  Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl
  HOTFIX: Update EMC_verif-global tag for Hera bug
  Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6
  move errchk definition from script to job for wave prdgen and gempak
  adding definition of errchk which was undefined in these scripts
  Issue NOAA-EMC#179 and issue NOAA-EMC#243 - update Fit2Obs to newm.1.2 tag and correct COMROOT path for Hera
  HOTFIX: Issue NOAA-EMC#241 - update EMC_verif-global tag to remove use of /tmp space
  Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag
  Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs
  Issue NOAA-EMC#179 - update to config.vrfy for Fit2Obs tag which supports Orion
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3
  Issue NOAA-EMC#233 - remove unnecessary extra space in tag line for gldas
  Issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  Issue #1:  update ecflow to be consistent with NCO's gfs.v16.0.4 and            update checkout to bring in new UPP tag (see issue NOAA-EMC#226)
  Upaded ush script scale_dec.sh
  Updated scripts gfs_v16.0

Refs: NOAA-EMC#178
lgannoaa pushed a commit that referenced this pull request Jul 26, 2021
* origin/develop:
  remove flags that were not present in Makefiles
  update jasper to 2.x.25. remove compiler flag in fv3nc2nemsio
  Update EMC_verif-global tag to verif_global_v1.13.4
  another use of _d where an _4 is needed
  Adjust how target is set for build_workflow_utils
  Add workflow_utils to build_all and link scripts
  copy/paste error from enkf_chgres_recenter.fd to enkf_chgres_recenter_nc.fd.  When going from nemsio to netcdf, the linking of ip, sp and w3nco changed from _d to _4.
  update .gitignore to exclude build and install directories as well as compiled files. bugfix in build_workflow_utils.sh hack. nceplibs-ncio now creates the module ncio and not fv3gfs_ncio.
  add cmake build capability for workflow utilities
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update Fit2Obs tag to newm.1.3 for bugfix
  Update EMC_verif-global tag for Hera bug
  Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl
  HOTFIX: Update EMC_verif-global tag for Hera bug
  Issue #1 and issue NOAA-EMC#238 - update Externals.cfg to match checkout.sh updates for v16.0.6
  move errchk definition from script to job for wave prdgen and gempak
  adding definition of errchk which was undefined in these scripts
  Issue #1 and issue NOAA-EMC#233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0
  Issue #1 and issue NOAA-EMC#241 - update EMC_verif-global tag
  Issue #1 and issue NOAA-EMC#238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg
  Issue #1 and issue NOAA-EMC#226 - update UPP tag to upp_gfsv16_release.v1.1.3
  Issue #1 and issue NOAA-EMC#226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  issue NOAA-EMC#227 reducing output bufr files to 64 levels per NCO request
  Issue #1:  update ecflow to be consistent with NCO's gfs.v16.0.4 and            update checkout to bring in new UPP tag (see issue NOAA-EMC#226)
  Upaded ush script scale_dec.sh
  Updated scripts gfs_v16.0

Conflicts:
	Externals.cfg
	sorc/checkout.sh

Refs: NOAA-EMC#164
lgannoaa pushed a commit that referenced this pull request Dec 27, 2021
lgannoaa pushed a commit that referenced this pull request Feb 9, 2022
* Initial spack/cmake version

* updated for umbrella build

* tweak to findnetcdf

* added include directory

* updated cmake

* changed to https for cmake submodule

* updated cmake submodule

* updated install directory

* added build for libnceppost.a

* modifications for macOS clang/gfortran build

* updated for gnu build

* udpated cmake submodule

* Add RST file for UPP v4.0

* Modifying introduction

* merged develop in and separated library from executable in build

* Update CMakeLists.txt files to support GNU compilers

* applied patch from Dusan

* Add conf.py for upp documentation

* Add index.rst for upp documentation

* Add readthedocs config file

* Modify name of main rst doc in index for readthedocs build test

* Change master file to index

* Edits for UFS documentation to remove WRF and grib1 references

* Add a readthedocs config file

* Mods to config and index files for use in readthedocs

* Update submodule pointer for cmake

* Remove old GNU makefiles with problematic names (only differing in case from existing files)

* Add files for GRIB2 table of fields

* Update .gitmodules, add branch = ufs_release_1.0 for cmake

* Update .gitmodules for testing, code review and merging

* Update include/lib flags for sigio, sfcio, nemsio

* Add REQUIRED attribute to find_package calls in CMakeLists.txt

* Comment out LAPACK dependency in CMakeLists.txt

* Revert change to .gitmodules, update submodule pointer for cmake

* sorc/ncep_post.fd/CMakeLists.txt: change GFSIO_INC to GFSIO_INC4

* Add capacity of detecting scaning mode north2south vs south2north in gaussian grid from Dusan.

* Re-factor CMake

* Fix library linking

* small fix to kyles refactor

* Add capacity of detecting scaning mode north2south vs south2north in gaussian grid from Dusan.

* Fix typo in sorc/ncep_post.fd/CMakeLists.txt

* Fix how Intel compile options with spaces in them are handled

* Update branch name for cmake submodule, update submodule pointer

* Update submodule pointer for cmake

* Update .gitmodules and submodule pointer for cmake, bugfixes for CMakeLists.txt

* Update submodule pointer for cmake

* fixes problem linking ncep_post with gnu/openmpi

* Update submodule pointer for cmake

* Revert .gitmodules change

* Bugfix: comment out debug print statement that can lead to out-of-bounds access; update submodule pointer for cmake

* Update submodule pointer for cmake

* OpenMP bugfix, use lowercase in find_package(CRTM)

* Fix post crash on macOS: use allocatable array

* Update submodule pointer for cmake

* Add UFS UPP rst documentation

* Update submodule pointer for cmake

* Rename g2tmpl_d to g2tmpl (NOAA-EMC#89)

* Update submodule pointer for cmake

* cleanup post

Change-Id: Ie52af5ff79ac4122e79d7a46e89ee2077188b0a4

* we dont depend on C HDF5 library. remove.

Change-Id: I26aa7c0bf7ed2783de1a9967d961d0260dee8b54

* use transitive properties. apply OpenMP flags if OpenMP is found. Formatting using cmake-format

Change-Id: Ic08ce6bc85a7d949c779ec597241c8cb4c20db86

* add debug gnu flags. compile_definitions does not like the quotes around long long, remove

Change-Id: Iccd5bb496944f75a79500729051dd571303cb50f

* Update CMakeLists.txt

* Update submodule pointer for cmake

* Update submodule pointer for cmake

* Add LGPL license to repository

* EMC_post is a Fortran only project. blockIO.c is not used, so do not include in building

* Update submodule pointer for cmake

* Bug fix for unary operator in INITPOST_GFS_NEMS_MPIIO.f. (NOAA-EMC#92)

* Remove old unused makefiles

* CMakeLists.txt: install postxconfig-NT-GFS-F00.txt and postxconfig-NT-GFS.txt in share directory

* Update version

@fossell says post is at version 8.0.0

* Update submodule pointer for cmake

* Fix Out of Bound Exception in GFSPOST.F (NOAA-EMC#100)

* Fix out-of-bound error in tpause routine in GFSPOST.F

* Fix use of undefined variables.

* Feature/cleanup (NOAA-EMC#95)

* cleanup post

Change-Id: Ie52af5ff79ac4122e79d7a46e89ee2077188b0a4

* we dont depend on C HDF5 library. remove.

Change-Id: I26aa7c0bf7ed2783de1a9967d961d0260dee8b54

* use transitive properties. apply OpenMP flags if OpenMP is found. Formatting using cmake-format

Change-Id: Ic08ce6bc85a7d949c779ec597241c8cb4c20db86

* add debug gnu flags. compile_definitions does not like the quotes around long long, remove

Change-Id: Iccd5bb496944f75a79500729051dd571303cb50f

* Update CMakeLists.txt

* EMC_post is a Fortran only project. blockIO.c is not used, so do not include in building

* Update version

@fossell says post is at version 8.0.0

* Revert "Feature/cleanup (NOAA-EMC#95)"

This reverts commit 7e9797b355d2b86ea9e274534f86adc42e866b95.

* remove unused compile definitions and update cmake pointer

Change-Id: Ie47cf16ebc25928bf30bfd05d4f25678219571a6

* Fix ID index in WRF-CHEM SMOKE block, which currently causes failed build in debug mode

* remove unnecessary commented line

* NetCDF static fix (#1)

* CMakeLists.txt: add MODULE to find_package calls

* Cleanup of NetCDF in CMakeLists.txt

* update cmake submodule pointer

Change-Id: I763882fd6ecc4b8cc64a60eddabccfdb7046040d

* Add MODULE to find_package(NetCDF) call (NOAA-EMC#3)

* update cmake submodule pointer

Change-Id: I69015efa425658645567e9d9f22d5e51301c1a0b

* Change version from 8.0.0 to 1.0.0

* fix the install path of compiled Fortran module files

Co-authored-by: Mark A Potts <mark.potts@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: Mark Potts <33099090+mark-a-potts@users.noreply.github.com>
Co-authored-by: Tracy <hertneky@ucar.edu>
Co-authored-by: Kate Fossell <fossell@ucar.edu>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Wen Meng <wen.meng@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Kyle Gerheiser <kgerheiser@icloud.com>
Co-authored-by: Mark Potts <mpotts@redlineperf.com>
Co-authored-by: Kyle Gerheiser <3209794+kgerheiser@users.noreply.github.com>
Co-authored-by: Dom Heinzeller <dom.heinzeller@noaa.gov>
Co-authored-by: Tracy <tracy.hertneky@noaa.gov>
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants