Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JJOBs for archive and verification jobs #723

Closed
wants to merge 533 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
533 commits
Select commit Hold shift + click to select a range
095e8f2
Remove envvar from module-setup.*.inc scripts
KateFriedman-NOAA Jan 11, 2022
570f8f2
Update WAFS tag to gfs_wafs.v6.2.6
KateFriedman-NOAA Jan 11, 2022
c5a3375
Merge remote-tracking branch 'upstream/feature/ops-wcoss2' into featu…
lgannoaa Jan 11, 2022
139c33c
Update enkf structure changes in ecflow definition files
lgannoaa Jan 11, 2022
b82837f
Merge pull request #559 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 11, 2022
048e7c4
Reference to NCO version:
lgannoaa Jan 11, 2022
b2a57df
Remove remark from envir-p1.h and head.h
lgannoaa Jan 11, 2022
a78d6c7
Remove ecflow post assignment in envir-p1.h
lgannoaa Jan 11, 2022
82aad0c
Merge pull request #555 from lgannoaa/feature/ecflow-ops-ecf2
KateFriedman-NOAA Jan 12, 2022
84a43ef
Update ROTDIR in config.base.nco.static
KateFriedman-NOAA Jan 12, 2022
2f84692
Remove NCO if-block from JJOB scripts
KateFriedman-NOAA Jan 12, 2022
b804376
revert ecflow include files to NCO versions. Will adapt as necessary…
aerorahul Jan 12, 2022
5151d77
Update GLDAS tag to gldas_gfsv16_release.v1.24.0
KateFriedman-NOAA Jan 12, 2022
c8456ee
Update GLDAS and WAFS tags in release notes
KateFriedman-NOAA Jan 12, 2022
b63982f
Correct COMIN definitions
KateFriedman-NOAA Jan 12, 2022
daa54da
Merge pull request #564 from NOAA-EMC/feature/nco-ecflow-feedback
KateFriedman-NOAA Jan 12, 2022
c8297e6
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 12, 2022
0f2037e
add #PBS -l debug=true to all .ecf files
aerorahul Jan 12, 2022
5e05dd4
Update WAFS tag to gfs_wafs.v6.2.7
KateFriedman-NOAA Jan 12, 2022
89f68cd
Merge branch 'feature/ops-wcoss2' of https://github.com/KateFriedman-…
KateFriedman-NOAA Jan 12, 2022
82a0cf0
Merge pull request #566 from NOAA-EMC/feature/nco-pbs-debug-feedback
KateFriedman-NOAA Jan 12, 2022
5e8015c
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 12, 2022
f137ba4
Update COMIN paths for ukmet, ecmwf, and nam
KateFriedman-NOAA Jan 12, 2022
7ecd0a3
Correct COMIN paths in GEMPAK driver scripts
KateFriedman-NOAA Jan 12, 2022
e524460
Merge pull request #565 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 12, 2022
44e7b2e
every ecf script that loads cray-mpich, now loads PrgEnv-intel, crayp…
aerorahul Jan 12, 2022
506045d
every ecf script that loads compiler dependent module, now loads PrgE…
aerorahul Jan 12, 2022
4639d87
every ecf script that loads compiler dependent module, now loads PrgE…
aerorahul Jan 12, 2022
4c6bc2c
every ecf script that loads compiler dependent module, now loads PrgE…
aerorahul Jan 12, 2022
b4a6150
Merge pull request #568 from NOAA-EMC/feature/nco-ecf-module-load
KateFriedman-NOAA Jan 13, 2022
c4bd64a
remove memory requests of 500gb and request exclusive node instead
aerorahul Jan 13, 2022
3678aad
request exclusive node where ncpus=128
aerorahul Jan 13, 2022
c5e48e8
remove duplicate enkfgdas_post_fxxx.ecf files and rename f003 as master
aerorahul Jan 13, 2022
8a48cf0
remove remnant from PR555 that copied gdas/enkf to enkfgdas. add giti…
aerorahul Jan 13, 2022
7520bd2
Merge pull request #572 from NOAA-EMC/feature/nco-excl
KateFriedman-NOAA Jan 13, 2022
c1f5550
remove duplicate gdas_atmos_post_fxxx.ecf files and rename f000 as ma…
aerorahul Jan 13, 2022
2827717
ignore gdas/atmos/post/ forecast hour ecf links
aerorahul Jan 13, 2022
30afe11
fix typo that causes the opposite effect
aerorahul Jan 13, 2022
57e1611
remove duplicate gfs_atmos_post_fxxx.ecf files and rename f000 as master
aerorahul Jan 13, 2022
400b799
remove duplicate jgfs_atmos_awips_f*.ecf files and rename f000 as master
aerorahul Jan 13, 2022
d251748
remove duplicate jgfs_atmos_awips_g2_f*.ecf files and rename f000 as …
aerorahul Jan 13, 2022
f144a0c
remove duplicate jgfs_atmos_wafs_f*.ecf files and rename f00 as master
aerorahul Jan 13, 2022
6aea9fa
add gitignore in appropriate places to ignore links. update defs to …
aerorahul Jan 13, 2022
98e9b69
add script that sets up the links to the master.ecf that loop over fo…
aerorahul Jan 13, 2022
ee8a756
remove duplicate enkfgdas_post_fxxx.ecf files and rename f003 as master
aerorahul Jan 13, 2022
2f7ff6f
remove remnant from PR555 that copied gdas/enkf to enkfgdas. add giti…
aerorahul Jan 13, 2022
94b0c58
remove duplicate gdas_atmos_post_fxxx.ecf files and rename f000 as ma…
aerorahul Jan 13, 2022
4aa5702
ignore gdas/atmos/post/ forecast hour ecf links
aerorahul Jan 13, 2022
2035749
fix typo that causes the opposite effect
aerorahul Jan 13, 2022
2768c92
remove duplicate gfs_atmos_post_fxxx.ecf files and rename f000 as master
aerorahul Jan 13, 2022
e14d7d8
remove duplicate jgfs_atmos_awips_f*.ecf files and rename f000 as master
aerorahul Jan 13, 2022
29e355c
remove duplicate jgfs_atmos_awips_g2_f*.ecf files and rename f000 as …
aerorahul Jan 13, 2022
4587475
remove duplicate jgfs_atmos_wafs_f*.ecf files and rename f00 as master
aerorahul Jan 13, 2022
cf11f1d
add gitignore in appropriate places to ignore links. update defs to …
aerorahul Jan 13, 2022
33265f7
add script that sets up the links to the master.ecf that loop over fo…
aerorahul Jan 13, 2022
f876669
Merge branch 'feature/nco-remove-duplicate-ecfs' of https://github.co…
aerorahul Jan 13, 2022
f599b1d
add pesky blank lines at the end of script. reviewers are brutal
aerorahul Jan 13, 2022
6b5c83d
Merge pull request #574 from NOAA-EMC/feature/nco-remove-duplicate-ecfs
KateFriedman-NOAA Jan 13, 2022
249f13e
Add excl tag to jgfs_forecast.ecf
KateFriedman-NOAA Jan 13, 2022
9a79edc
Add excl tag to jgfs_atmos_gempak.ecf
KateFriedman-NOAA Jan 13, 2022
17b62fa
Add memory setting to jgfs_atmos_awips_master.ecf
KateFriedman-NOAA Jan 13, 2022
5a24f98
Add memory setting to jgfs_atmos_awips_g2_master.ecf
KateFriedman-NOAA Jan 13, 2022
9de87a5
Add memory setting to jgfs_atmos_wafs_blending.ecf
KateFriedman-NOAA Jan 13, 2022
f80321b
Add memory setting to jgfs_atmos_wafs_blending_0p25.ecf
KateFriedman-NOAA Jan 13, 2022
0a410c6
Add memory setting to jgfs_atmos_wafs_grib2.ecf
KateFriedman-NOAA Jan 13, 2022
18d2f01
Add memory setting to jgfs_atmos_wafs_grib2_0p25.ecf
KateFriedman-NOAA Jan 13, 2022
96beaf3
Add memory setting to jgfs_atmos_wafs_master.ecf
KateFriedman-NOAA Jan 13, 2022
9a9feff
Update v16.2.0 release notes for ecf script linking
KateFriedman-NOAA Jan 13, 2022
5ed75bc
Merge pull request #575 from KateFriedman-NOAA/feature/ops-wcoss2_ecf…
KateFriedman-NOAA Jan 13, 2022
7e4179a
Update NCO resource config for memory
KateFriedman-NOAA Jan 13, 2022
e1afd40
Add imagemagick_ver=7.0.8-7 to run.ver
KateFriedman-NOAA Jan 13, 2022
ff27633
Update workflow_utils.py to support exclusive
KateFriedman-NOAA Jan 13, 2022
d6040c3
Update release notes for new EMC tag
KateFriedman-NOAA Jan 13, 2022
a71de49
Update post jobs ecf script resources
KateFriedman-NOAA Jan 13, 2022
65b1a82
Update post job resources in config.resources.nco.static
KateFriedman-NOAA Jan 13, 2022
4176fd9
Merge pull request #576 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 13, 2022
c9ffab5
post/anl job is the same as the forecast hour. create a link, instea…
aerorahul Jan 15, 2022
4d5e215
some PBS jobnames were hardwired gdas or gfs, while some inherited fr…
aerorahul Jan 16, 2022
e2a3cde
remove gdas remnant from enkfgdas jobnames
aerorahul Jan 18, 2022
e16e1de
put NCO identified changes from the global-workflow in a branch
aerorahul Jan 18, 2022
f6960ee
wave init jobs just need cray-pals per NCO. remove rest
aerorahul Jan 18, 2022
c34897c
Merge pull request #585 from NOAA-EMC/hotfix/fix-missing-post_anl-res…
KateFriedman-NOAA Jan 18, 2022
c3290ce
Merge branch 'feature/ops-wcoss2' into feature/ecf_jobnames
aerorahul Jan 18, 2022
3a34176
Merge pull request #586 from NOAA-EMC/feature/ecf_jobnames
KateFriedman-NOAA Jan 18, 2022
30324b2
Merge branch 'feature/ops-wcoss2' into feature/nco-fixes-20210118
aerorahul Jan 18, 2022
792b3a1
Merge pull request #590 from NOAA-EMC/feature/nco-fixes-20210118
KateFriedman-NOAA Jan 18, 2022
8aa942e
Update GLDAS tag to gldas_gfsv16_release.v1.25.0
KateFriedman-NOAA Jan 18, 2022
41fcaf2
Update GLDAS tag in release notes
KateFriedman-NOAA Jan 18, 2022
415ec5d
Merge pull request #591 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 19, 2022
5dab1ca
Remove unneeded COM paths from wavepostsbs JJOB
KateFriedman-NOAA Jan 20, 2022
7dab015
fix resource allocations for some jobs that NCO flagged were allocati…
aerorahul Jan 20, 2022
3865f87
update resources for wave init, post and prep jobs in ecf scripts
aerorahul Jan 20, 2022
a8fee47
update resources for atmos gempak in ecf scripts
aerorahul Jan 20, 2022
8ef381b
update resources for atmos gempak_meta in ecf scripts
aerorahul Jan 20, 2022
6b42112
update resources for atmos pp wafs_gcip in ecf scripts
aerorahul Jan 20, 2022
8b359e2
update resources for atmos chgres for enkf in ecf scripts
aerorahul Jan 20, 2022
a1ca249
update resources for wave jobs to include memory in ecf scripts
aerorahul Jan 21, 2022
3c72261
update resources for more jobs to include memory in ecf scripts. wav…
aerorahul Jan 21, 2022
f51f37e
update resources for jgdas_atmos_tropcy_qc_reloc.ecf. Remove develop…
aerorahul Jan 21, 2022
9ec6537
update resources for jgfs_atmos_tropcy_qc_reloc.ecf. Remove develope…
aerorahul Jan 21, 2022
45dad23
update resources for more jobs in ecf scripts from NCO
aerorahul Jan 21, 2022
b03f434
update resources for more jobs in ecf scripts from NCO
aerorahul Jan 21, 2022
e119ca8
Update memory setting in workflow_utils for gfs
KateFriedman-NOAA Jan 25, 2022
6751660
Add missing get_awipsgroups function to fcstonly
KateFriedman-NOAA Jan 25, 2022
3cd0d8a
Update to WCOSS2 env file for waveprep job
KateFriedman-NOAA Jan 25, 2022
7212af6
Update analysis job ecf resource settings
KateFriedman-NOAA Jan 25, 2022
99a1209
Update for C768 gdasfcst job resource settings
KateFriedman-NOAA Jan 25, 2022
2c93630
Numerous resource updates based on optimization
KateFriedman-NOAA Jan 25, 2022
eac7e62
Update resources for gdasesfc job in ecf script
KateFriedman-NOAA Jan 25, 2022
9fb4ad8
Add COMIN_OBS/COMIN_GES_OBS and related xml support
KateFriedman-NOAA Jan 25, 2022
5115509
Add COMIN_OBS/COMIN_GES_OBS and related xml support
KateFriedman-NOAA Jan 25, 2022
ee2c417
Merge pull request #605 from KateFriedman-NOAA/feature/ops-wcoss2_fixes
KateFriedman-NOAA Jan 25, 2022
75a19a9
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 25, 2022
cf4b36a
Cleanup of config.fv3.nco.static
KateFriedman-NOAA Jan 25, 2022
97b6810
Merge branch 'feature/ops-wcoss2' of https://github.com/KateFriedman-…
KateFriedman-NOAA Jan 25, 2022
cea3b56
Update config.resource.emc.dyn with tested values
KateFriedman-NOAA Jan 25, 2022
fdd33e8
Update C384 and C768 values in config.fv3.emc.dyn
KateFriedman-NOAA Jan 25, 2022
8698181
Update esfc and analysis job resources
KateFriedman-NOAA Jan 25, 2022
3c8f4b8
Update gdasechgres job resources
KateFriedman-NOAA Jan 25, 2022
c74acb9
Update analysis job walltime to 50 mins
KateFriedman-NOAA Jan 25, 2022
0cc3707
bringing in changes from @WeiWei-NCO after his testing
aerorahul Jan 25, 2022
44309c3
remove obsproc ecfs and there references from suite.def. work needs …
aerorahul Jan 25, 2022
964c72a
Optimization resource updates from NCO
KateFriedman-NOAA Jan 26, 2022
77381ca
Update analysis job walltime to 50mins
KateFriedman-NOAA Jan 26, 2022
5e54f2f
Merge pull request #603 from NOAA-EMC/feature/nco-fixes-red-numbers
KateFriedman-NOAA Jan 26, 2022
adb7706
Merge remote-tracking branch 'upstream/feature/ops-wcoss2' into featu…
KateFriedman-NOAA Jan 26, 2022
307b6ca
Merge remote-tracking branch 'origin/feature/ops-wcoss2' into feature…
KateFriedman-NOAA Jan 26, 2022
63e4da4
A few resource updates from NCO and WCOSS_C removal
KateFriedman-NOAA Jan 26, 2022
7cfd9a1
Merge pull request #608 from NOAA-EMC/feature/remove-obsproc-tasks
KateFriedman-NOAA Jan 26, 2022
679312b
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 26, 2022
3c6a255
Merge pull request #606 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 26, 2022
03101ca
Remove nth_max usage in WCOSS2.env
KateFriedman-NOAA Jan 28, 2022
d6a14bf
Reduce gdas analysis job walltime back to 40mins
KateFriedman-NOAA Jan 28, 2022
fa98fe3
Comment out job variable in awips ecf scripts
KateFriedman-NOAA Jan 28, 2022
a65c77a
Correct config list for wavepostbndpntbll job
KateFriedman-NOAA Jan 28, 2022
765917f
Change RUN to RUN2 in gempak pgrb2 spec script
KateFriedman-NOAA Jan 28, 2022
52322e2
Change RUN to RUN2 in awips scripts
KateFriedman-NOAA Jan 28, 2022
cbc916e
Resource updates for analysis and eobs
KateFriedman-NOAA Jan 28, 2022
f2573bf
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 28, 2022
0d9c46b
Resource adjustments for eobs, waveprep, gfspost
KateFriedman-NOAA Jan 28, 2022
4bdd75b
Back out comment of job variable in awips scripts
KateFriedman-NOAA Jan 28, 2022
30d6644
Update gempak job in setup_workflow scripts
KateFriedman-NOAA Jan 28, 2022
efc8611
Update GEMPAK scripts
KateFriedman-NOAA Jan 28, 2022
53b101e
GEMPAK_META script updates from Boi
KateFriedman-NOAA Jan 28, 2022
c4b4cb5
Update GFSv16.2.0 release notes
KateFriedman-NOAA Jan 28, 2022
c404b8e
Remove excl for gfswaveprep job PBS directive
KateFriedman-NOAA Jan 28, 2022
a2823cd
Merge pull request #616 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 28, 2022
22185a3
Update GLDAS tag to gldas_gfsv16_release.v.1.28.0
KateFriedman-NOAA Jan 28, 2022
2d3548a
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Jan 28, 2022
7ff7a54
Add missing character to GLDAS tag in release notes
KateFriedman-NOAA Jan 28, 2022
cacd3de
Merge branch 'feature/ops-wcoss2' of https://github.com/KateFriedman-…
KateFriedman-NOAA Jan 28, 2022
ea3ff8c
Merge pull request #617 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 28, 2022
d41192c
Update to correct infinite loop in gempak script
KateFriedman-NOAA Jan 31, 2022
7801866
Update several GSI/EnKF job resources
KateFriedman-NOAA Jan 31, 2022
67f32d3
Remove npe_node_eupd=9 setting on WCOSS2
KateFriedman-NOAA Jan 31, 2022
ced73be
Change npe_analdiag to 96
KateFriedman-NOAA Jan 31, 2022
16f27c8
Update EMC tag name in release notes
KateFriedman-NOAA Jan 31, 2022
a8d52c7
Remove non-WCOSS2 references in nco.static configs
KateFriedman-NOAA Jan 31, 2022
5a080b4
Merge pull request #620 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Jan 31, 2022
c602f04
Add missing EXPDIR setting to JGDAS_ATMOS_GEMPAK
KateFriedman-NOAA Feb 1, 2022
adfd237
Adjust analysis job walltimes for ops
KateFriedman-NOAA Feb 1, 2022
5a4f453
Merge pull request #623 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Feb 1, 2022
be7e439
The following scripts changed to remove module load wgrib2:
lgannoaa Feb 3, 2022
3777a7c
Correct analysis job walltimes in config.resources
KateFriedman-NOAA Feb 3, 2022
0e081f9
1.
lgannoaa Feb 3, 2022
a5a1e72
Remove esmf from enkf fcst
lgannoaa Feb 4, 2022
b3a6c8c
Remove hardwired DELL path util/ush/make_tif.sh
lgannoaa Feb 4, 2022
303f9bb
Merge pull request #634 from lgannoaa/feature/pr-534
KateFriedman-NOAA Feb 7, 2022
459e0ad
Merge branch 'NOAA-EMC:feature/ops-wcoss2' into feature/ops-wcoss2
KateFriedman-NOAA Feb 7, 2022
0de0497
Merge pull request #637 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Feb 8, 2022
c1dad5b
Add the following scripts changed to remove module load libjpeg:
lgannoaa Feb 8, 2022
90a69be
Rename Orion modulefiles for LUA format
KateFriedman-NOAA Feb 8, 2022
d83597f
Remove uneeded modulefiles for Orion/WCOSS-Dell
KateFriedman-NOAA Feb 9, 2022
6ccc0e6
Merge pull request #629 from lgannoaa/feature/pr-587
KateFriedman-NOAA Feb 9, 2022
6e88009
Update Orion modulefiles to LUA format and hpc-stack
KateFriedman-NOAA Feb 9, 2022
73b5664
Add myFC variable to WCOSS2 modulefiles
KateFriedman-NOAA Feb 9, 2022
b246fd3
Update fbwndgfs and storm_reloc builds to use myFC
KateFriedman-NOAA Feb 9, 2022
50cf445
Cleanup machine-setup.sh
KateFriedman-NOAA Feb 9, 2022
4f063a9
Update gfs_bufrsnd build for hpc-stack
KateFriedman-NOAA Feb 9, 2022
5c11513
Update machine-setup.sh target version sourcing
KateFriedman-NOAA Feb 9, 2022
de03082
Update NETCDF_LDFLAGS_F in gaussian_sfcanl build
KateFriedman-NOAA Feb 9, 2022
529dfd6
Add $target.ver sourcing for Orion/Hera to load_fv3gfs_modules.sh
KateFriedman-NOAA Feb 9, 2022
1af6dfa
Update build_regrid_nemsio.sh with NETCDF_LDFLAGS
KateFriedman-NOAA Feb 10, 2022
55b9eb8
Rename Hera modulefiles to add .lua extension
KateFriedman-NOAA Feb 10, 2022
d005cb6
Create new $target.ver files for Hera and Orion
KateFriedman-NOAA Feb 10, 2022
ed6024d
Remove unneeded modulefile.grib_util.hera.lua
KateFriedman-NOAA Feb 10, 2022
e50fea9
Convert Hera modulefiles to LUA format and hpc-stack
KateFriedman-NOAA Feb 10, 2022
28d1a7b
Remove unneeded module loads from enkf_chgres_recenter build
KateFriedman-NOAA Feb 11, 2022
75fb6da
Remove unneeded modules from fbwndgfs build
KateFriedman-NOAA Feb 11, 2022
7425fd6
Add HPSS module load back into Hera module_base
KateFriedman-NOAA Feb 11, 2022
1901756
Create wcoss2.ver
KateFriedman-NOAA Feb 11, 2022
40253b9
Update SIGIO library variables in build_tropcy_NEMS.sh
KateFriedman-NOAA Feb 11, 2022
7b3b96e
Add prod_util_ver to orion.ver
KateFriedman-NOAA Feb 15, 2022
3aab53f
Add prod_util_ver and cmake_ver to hera.ver
KateFriedman-NOAA Feb 15, 2022
238efed
Add cmake_ver to orion.ver
KateFriedman-NOAA Feb 15, 2022
626306d
Merge pull request #648 from KateFriedman-NOAA/dev_v16
KateFriedman-NOAA Feb 15, 2022
1718049
Merge remote-tracking branch 'upstream/feature/ops-wcoss2' into dev_v16
KateFriedman-NOAA Feb 15, 2022
1470d47
Merge pull request #653 from KateFriedman-NOAA/dev_v16
KateFriedman-NOAA Feb 15, 2022
ee42d81
Update compilation flags for gaussian_sfcanl build
KateFriedman-NOAA Feb 18, 2022
14bccc7
Add OMP_PLACES=cores for fcst block in WCOSS2.env
KateFriedman-NOAA Feb 18, 2022
af84c9c
Update several versions in run.ver
KateFriedman-NOAA Feb 18, 2022
2a6dc07
Update gfs_forecast job resources
KateFriedman-NOAA Feb 18, 2022
cbb31c9
Move excl setting into resource line in ecf scripts
KateFriedman-NOAA Feb 18, 2022
a7b7b20
GFS v16.1.6: GSI update to add commercial GPSRO in DO-4
CatherineThomas-NOAA Feb 18, 2022
6b5580e
Script updates from NCO
KateFriedman-NOAA Feb 18, 2022
a194f07
Updates to run.ver and create wcoss2.ver
KateFriedman-NOAA Feb 18, 2022
1e9e4cd
Update EMC tag name in v16.2.0 release notes
KateFriedman-NOAA Feb 18, 2022
1a9c437
Update wave job resources with NCO feedback
KateFriedman-NOAA Feb 18, 2022
1a2d8a8
Move transfer lists into new transfer folder
KateFriedman-NOAA Feb 18, 2022
5f22d9c
Fold in transfer parm list updates from NCO
KateFriedman-NOAA Feb 18, 2022
b9ba983
Updates to support wcoss2.ver
KateFriedman-NOAA Feb 18, 2022
38a3225
Update npe_node_fcst_gfs in config.resources.emc.dyn
KateFriedman-NOAA Feb 18, 2022
9546c38
GFS v16.1.6: Update release notes and comment in config.anal
CatherineThomas-NOAA Feb 18, 2022
c82e3c9
Update WAFS tag to gfs_wafs.v6.2.8
KateFriedman-NOAA Feb 22, 2022
f3ce093
Remove commented out lines from transfer lists
KateFriedman-NOAA Feb 22, 2022
9a74a80
Move all PBS place settings to separate line
KateFriedman-NOAA Feb 22, 2022
f448b67
Merge pull request #661 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Feb 22, 2022
c170217
Update release notes for current ops version
KateFriedman-NOAA Feb 22, 2022
f83cd9f
Merge remote-tracking branch 'upstream/release/gfs.v16.1.6' into feat…
KateFriedman-NOAA Feb 22, 2022
835dc64
Update Externals.cfg with GFSv16.2.0 component versions
KateFriedman-NOAA Feb 22, 2022
cd1d3d0
Update DMPDIR and BASE_GIT paths for WCOSS2
KateFriedman-NOAA Feb 22, 2022
1a4338f
Merge pull request #663 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Feb 22, 2022
8b6a576
Update GLDAS tag to gldas_gfsv16_release.v.2.0.0
KateFriedman-NOAA Feb 23, 2022
74e0a1f
Merge pull request #664 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Feb 23, 2022
a4ed22a
Merge remote-tracking branch 'upstream/feature/ops-wcoss2' into dev_v16
KateFriedman-NOAA Feb 23, 2022
0eab451
Merge pull request #666 from KateFriedman-NOAA/dev_v16
KateFriedman-NOAA Feb 24, 2022
b21c84c
Library flag and variable updates for some builds
KateFriedman-NOAA Mar 2, 2022
e1b3edd
Update FC and LIBS in several makefiles
KateFriedman-NOAA Mar 2, 2022
0e90a2d
Remove png module from modulefile.storm_reloc_v6.0.0.orion.lua
KateFriedman-NOAA Mar 2, 2022
f0b60cb
Add needed gempak subfolder to gempak ush scripts
KateFriedman-NOAA Mar 22, 2022
621dfa6
Merge pull request #689 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Mar 22, 2022
3d1e7e8
Add obsproc/prepobs run versions to wcoss2.ver
KateFriedman-NOAA Mar 24, 2022
0deb00b
Update prep.sh to use new WCOSS2 obsproc packages
KateFriedman-NOAA Mar 24, 2022
bee6dc9
Update obsproc package settings in dev config.base
KateFriedman-NOAA Mar 24, 2022
f5d83d5
Update HOMEobsproc paths in config.base.nco.static
KateFriedman-NOAA Mar 28, 2022
40ffa25
Merge pull request #696 from KateFriedman-NOAA/feature/ops-wcoss2
KateFriedman-NOAA Mar 28, 2022
deac1ec
Merge pull request #697 from NOAA-EMC/feature/ops-wcoss2
KateFriedman-NOAA Mar 28, 2022
48622c6
Merge branch 'NOAA-EMC:dev_v16' into dev_v16
KateFriedman-NOAA Mar 28, 2022
9808d82
Remove nemsio code symlinks from link_fv3gfs.sh
KateFriedman-NOAA Mar 28, 2022
32c59d4
Add WAFS checkout to ops-only option
KateFriedman-NOAA Mar 28, 2022
b44b9af
Build updates for hpc-stack-gfsv16 on Orion
KateFriedman-NOAA Mar 29, 2022
089853b
Update orion.ver
KateFriedman-NOAA Mar 29, 2022
692c977
Update Hera modulefiles for hpc-stack-gfsv16
KateFriedman-NOAA Mar 29, 2022
7461a87
Update hera.ver
KateFriedman-NOAA Mar 29, 2022
6ec386f
Update checkout.sh component versions for R&D support
KateFriedman-NOAA Mar 29, 2022
c52e4b8
Update component versions in checkout.sh
KateFriedman-NOAA Mar 30, 2022
fdd4fcd
Update build_fv3.sh WW3 option depending on platform
KateFriedman-NOAA Mar 30, 2022
9b664c8
Clean out commented out line in enkf_chgres_recenter_nc.fd/makefile
KateFriedman-NOAA Mar 30, 2022
698f3bf
Merge pull request #700 from KateFriedman-NOAA/dev_v16
KateFriedman-NOAA Apr 4, 2022
339ac25
Archive JJOBs are created
lgannoaa Apr 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
198 changes: 188 additions & 10 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,16 +1,194 @@
# Ignore all compiled files
#--------------------------
__pycache__
*.pyc
*.o
*.[aox]
*.mod
*.sw[a-p]

# Ignore exec folder
# Ignore folders
#-------------------
exec/
build*/
install*/

# Ignore sorc folders from externals
sorc/logs/
sorc/fv3gfs.fd/
sorc/gfs_post.fd/
sorc/gsi.fd/
sorc/ufs_utils.fd/
sorc/gfs_wafs.fd/
sorc/verif-global.fd/
# Ignore fix directory symlinks
#------------------------------
fix/0readme
fix/fix_*
fix/gdas/
fix/wafs

# Ignore parm file symlinks
#--------------------------
parm/config/config.base
parm/config/config.fv3
parm/config/config.resources
parm/gldas
parm/mon
parm/post
parm/wafs

# Ignore sorc and logs folders from externals
#--------------------------------------------
sorc/*log
sorc/logs
sorc/fv3gfs.fd
sorc/gfs_post.fd
sorc/gfs_wafs.fd
sorc/gsi.fd
sorc/ufs_utils.fd
sorc/verif-global.fd

# Ignore sorc symlinks
#---------------------
sorc/calc_analysis.fd
sorc/calc_increment_ens.fd
sorc/calc_increment_ens_ncio.fd
sorc/emcsfc_ice_blend.fd
sorc/emcsfc_snow2mdl.fd
sorc/filter_topo.fd
sorc/fregrid.fd
sorc/gdas2gldas.fd
sorc/getsfcensmeanp.fd
sorc/getsigensmeanp_smooth.fd
sorc/getsigensstatp.fd
sorc/gfs_ncep_post.fd
sorc/gldas.fd
sorc/gldas2gdas.fd
sorc/gldas_forcing.fd
sorc/gldas_model.fd
sorc/gldas_post.fd
sorc/gldas_rst.fd
sorc/global_chgres.fd
sorc/global_cycle.fd
sorc/global_enkf.fd
sorc/global_gsi.fd
sorc/interp_inc.fd
sorc/make_hgrid.fd
sorc/make_solo_mosaic.fd
sorc/mkgfsnemsioctl.fd
sorc/ncdiag_cat.fd
sorc/nemsio_chgdate.fd
sorc/nemsio_get.fd
sorc/nemsio_read.fd
sorc/nst_tf_chg.fd
sorc/orog.fd
sorc/oznmon_horiz.fd
sorc/oznmon_time.fd
sorc/radmon_angle.fd
sorc/radmon_bcoef.fd
sorc/radmon_bcor.fd
sorc/radmon_time.fd
sorc/recentersigp.fd
sorc/shave.fd
sorc/wafs_awc_wafavn.fd
sorc/wafs_blending.fd
sorc/wafs_blending_0p25.fd
sorc/wafs_cnvgrib2.fd
sorc/wafs_gcip.fd
sorc/wafs_grib2_0p25.fd
sorc/wafs_makewafs.fd
sorc/wafs_setmissing.fd

# Ignore scripts from externals
#------------------------------
# jobs symlinks
jobs/JGDAS_ATMOS_ANALYSIS_DIAG
jobs/JGDAS_ATMOS_CHGRES_FORENKF
jobs/JGDAS_ATMOS_GLDAS
jobs/JGDAS_ATMOS_VERFOZN
jobs/JGDAS_ATMOS_VERFRAD
jobs/JGDAS_ATMOS_VMINMON
jobs/JGDAS_ENKF_DIAG
jobs/JGDAS_ENKF_ECEN
jobs/JGDAS_ENKF_FCST
jobs/JGDAS_ENKF_POST
jobs/JGDAS_ENKF_SELECT_OBS
jobs/JGDAS_ENKF_SFC
jobs/JGDAS_ENKF_UPDATE
jobs/JGFS_ATMOS_VMINMON
jobs/JGFS_ATMOS_WAFS
jobs/JGFS_ATMOS_WAFS_BLENDING
jobs/JGFS_ATMOS_WAFS_BLENDING_0P25
jobs/JGFS_ATMOS_WAFS_GCIP
jobs/JGFS_ATMOS_WAFS_GRIB2
jobs/JGFS_ATMOS_WAFS_GRIB2_0P25
jobs/JGLOBAL_ATMOS_ANALYSIS
jobs/JGLOBAL_ATMOS_ANALYSIS_CALC
jobs/JGLOBAL_ATMOS_NCEPPOST
jobs/JGLOBAL_ATMOS_POST_MANAGER
# scripts symlinks
scripts/exemcsfc_global_sfc_prep.sh
scripts/exgdas_atmos_chgres_forenkf.sh
scripts/exgdas_atmos_gldas.sh
scripts/exgdas_atmos_nceppost.sh
scripts/exgdas_atmos_verfozn.sh
scripts/exgdas_atmos_verfrad.sh
scripts/exgdas_atmos_vminmon.sh
scripts/exgdas_enkf_ecen.sh
scripts/exgdas_enkf_fcst.sh
scripts/exgdas_enkf_post.sh
scripts/exgdas_enkf_select_obs.sh
scripts/exgdas_enkf_sfc.sh
scripts/exgdas_enkf_update.sh
scripts/exgfs_atmos_nceppost.sh
scripts/exgfs_atmos_vminmon.sh
scripts/exgfs_atmos_wafs_blending.sh
scripts/exgfs_atmos_wafs_blending_0p25.sh
scripts/exgfs_atmos_wafs_gcip.sh
scripts/exgfs_atmos_wafs_grib.sh
scripts/exgfs_atmos_wafs_grib2.sh
scripts/exgfs_atmos_wafs_grib2_0p25.sh
scripts/exglobal_atmos_analysis.sh
scripts/exglobal_atmos_analysis_calc.sh
scripts/exglobal_atmos_pmgr.sh
scripts/exglobal_diag.sh
# ush symlinks
ush/calcanl_gfs.py
ush/calcinc_gfs.py
ush/emcsfc_ice_blend.sh
ush/emcsfc_snow.sh
ush/fix_precip.sh
ush/fv3gfs_chgres.sh
ush/fv3gfs_downstream_nems.sh
ush/fv3gfs_driver_grid.sh
ush/fv3gfs_dwn_nems.sh
ush/fv3gfs_filter_topo.sh
ush/fv3gfs_make_grid.sh
ush/fv3gfs_make_orog.sh
ush/getncdimlen
ush/gfs_nceppost.sh
ush/gfs_transfer.sh
ush/gldas_archive.sh
ush/gldas_forcing.sh
ush/gldas_get_data.sh
ush/gldas_liscrd.sh
ush/gldas_post.sh
ush/gldas_process_data.sh
ush/global_chgres.sh
ush/global_chgres_driver.sh
ush/global_cycle.sh
ush/global_cycle_driver.sh
ush/gsi_utils.py
ush/link_crtm_fix.sh
ush/minmon_xtrct_costs.pl
ush/minmon_xtrct_gnorms.pl
ush/minmon_xtrct_reduct.pl
ush/mkwfsgbl.sh
ush/mod_icec.sh
ush/ozn_xtrct.sh
ush/radmon_ck_stdout.sh
ush/radmon_err_rpt.sh
ush/radmon_verf_angle.sh
ush/radmon_verf_bcoef.sh
ush/radmon_verf_bcor.sh
ush/radmon_verf_time.sh
ush/trim_rh.sh
ush/wafs_blending.sh
ush/wafs_grib2.regrid.sh
ush/wafs_intdsk.sh
# util symlinks
util/sub_slurm
util/sub_wcoss_c
util/sub_wcoss_d
18 changes: 9 additions & 9 deletions Externals.cfg
Original file line number Diff line number Diff line change
@@ -1,37 +1,37 @@
# External sub-modules of global-workflow

[FV3GFS]
tag = GFS.v16.0.16
tag = GFS.v16.2.0
local_path = sorc/fv3gfs.fd
repo_url = https://github.com/ufs-community/ufs-weather-model.git
protocol = git
required = True

[GSI]
tag = gfsda.v16.1.0
tag = gfsda.v16.2.0
local_path = sorc/gsi.fd
repo_url = https://github.com/NOAA-EMC/GSI.git
protocol = git
required = True

[GLDAS]
tag = gldas_gfsv16_release.v1.12.0
tag = gldas_gfsv16_release.v.2.0.0
local_path = sorc/gldas.fd
repo_url = https://github.com/NOAA-EMC/GLDAS.git
protocol = git
required = True

[EMC_post]
tag = upp_gfsv16_release.v1.1.3
[UPP]
tag = upp_v8.1.0
local_path = sorc/gfs_post.fd
repo_url = https://github.com/NOAA-EMC/EMC_post.git
repo_url = https://github.com/NOAA-EMC/UPP.git
protocol = git
required = True

[UFS_UTILS]
tag = ops-gfsv16.0.0
tag = ops-gfsv16.2.0
local_path = sorc/ufs_utils.fd
repo_url = https://github.com/NOAA-EMC/UFS_UTILS.git
repo_url = https://github.com/ufs-community/UFS_UTILS.git
protocol = git
required = True

Expand All @@ -43,7 +43,7 @@ protocol = git
required = True

[EMC_gfs_wafs]
tag = gfs_wafs.v6.0.22
tag = gfs_wafs.v6.2.8
local_path = sorc/gfs_wafs.fd
repo_url = https://github.com/NOAA-EMC/EMC_gfs_wafs.git
protocol = git
Expand Down
Loading