Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dummy PR to trigger CI #2938

Closed
wants to merge 101 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
101 commits
Select commit Hold shift + click to select a range
61de004
Update ufs-weather-model (#2663)
JessicaMeixner-NOAA Jun 12, 2024
2e6f1fc
Link both global-nest fix files and non-nest ones at the same time (#…
guoqing-noaa Jun 12, 2024
5b2a3d4
Add COM template for JEDI obs (#2678)
WalterKolczynski-NOAA Jun 12, 2024
6c19a0e
Replace `sleep` with `wait_for_file` (#2586)
HenryRWinterbottom Jun 13, 2024
34155fb
Add ability to use GEFS replay ICs (#2559)
NeilBarton-NOAA Jun 13, 2024
ebacebf
Update gdas.cd and gsi_utils hashes (#2641)
RussTreadon-NOAA Jun 13, 2024
dc21eac
Add Hercules-EMC to the Jenkins configurable parameter list (#2685)
TerrenceMcGuinness-NOAA Jun 13, 2024
603a4a8
Update Jenkinsfile
TerrenceMcGuinness-NOAA Jun 13, 2024
5a5fc2b
Remove ocean daily files (#2689)
JessicaMeixner-NOAA Jun 14, 2024
6c93b45
Add observation preparation job for aerosols DA to workflow (#2624)
ypwang19 Jun 14, 2024
5af325a
Update GDASapp hash to move JCB into GDASapp (#2665)
danholdaway Jun 14, 2024
38f2df9
Optimize wavepostpnt (#2657)
DavidHuber-NOAA Jun 17, 2024
47b3a58
Turn on high-frequency output in extended test (#2679)
WalterKolczynski-NOAA Jun 18, 2024
35d4d99
Update archive job to use COMIN/COMOUT (#2668)
HenryRWinterbottom Jun 18, 2024
3270ac3
Hotfix for bug in template names. (#2697)
HenryRWinterbottom Jun 18, 2024
0b810c8
Removes misleading "No such file or directory" syntax errors from out…
HenryRWinterbottom Jun 19, 2024
8993b42
Eliminate post groups (#2667)
WalterKolczynski-NOAA Jun 20, 2024
f43a862
Fix and simplify online archiving and reenable METplus jobs (#2687)
DavidHuber-NOAA Jun 21, 2024
4e1b937
Add minimum software requirements (#2712)
DavidHuber-NOAA Jun 24, 2024
b902c0b
Assign machine- and RUN-specific resources (#2672)
DavidHuber-NOAA Jun 25, 2024
12431f7
Update wave jobs to use COMIN/COMOUT (#2643)
HenryRWinterbottom Jun 26, 2024
8962991
Update logic for MOM6 number of layers/exception values (#2681)
JessicaMeixner-NOAA Jun 26, 2024
7706760
Cleanup of stale RUNDIRS from an experiment (#2719)
aerorahul Jun 26, 2024
968568f
Activate snow DA test on WCOSS (#2720)
WalterKolczynski-NOAA Jun 26, 2024
9476c12
updated Finalize in Jenkinsfile and added try block around scm checko…
TerrenceMcGuinness-NOAA Jun 26, 2024
c49e4ee
Revert PR 2681 (#2739)
aerorahul Jun 28, 2024
de87067
Update for JCB policies and stage DA job files with Jinja2-templates …
RussTreadon-NOAA Jul 1, 2024
11943e3
Fix xml file setup and complete C48 ATM and S2SW runs for CI on Gaea …
DavidBurrows-NCO Jul 2, 2024
8215ae6
Hotfix for clusters from #2701 (#2747)
aerorahul Jul 2, 2024
7dc6651
Update gempak job to run one fcst hour per task (#2671)
GwenChen-NOAA Jul 3, 2024
2bd106a
Hotfix for undefined CLUSTERS (#2748)
DavidHuber-NOAA Jul 3, 2024
d65d3d2
Update ufs model hash to 20240625 (#2729)
JessicaMeixner-NOAA Jul 4, 2024
58fca16
Update (partially) global-workflow for orion+rocky9 (#2741)
aerorahul Jul 5, 2024
3ca7477
Add fcst dependency to ocnanalprep (#2728)
AndrewEichmann-NOAA Jul 9, 2024
8998ec7
Fix GDAS group B restart archiving (#2735)
DavidHuber-NOAA Jul 9, 2024
5ef4db7
Adds contents of constructor and initialize methods to marine LETKF c…
AndrewEichmann-NOAA Jul 11, 2024
4968f3a
CI maintenance updates and adding CI Unit Tests (#2740)
TerrenceMcGuinness-NOAA Jul 11, 2024
e0878db
Updated prepobs and fit2obs versions for Orion Rocky9 (#2758)
KateFriedman-NOAA Jul 15, 2024
fc668aa
Address issues in creating XML for GFS forecast-only with app S2SWA (…
aerorahul Jul 16, 2024
56df67a
Hotfix: Update jcb to avoid git-lfs files (#2782)
DavidHuber-NOAA Jul 22, 2024
71dc33c
Set METplus process count in config.metp; add verif-global support fo…
DavidHuber-NOAA Jul 22, 2024
c45b961
Add task to process reforecast variables to save on WCOSS2 (#2680)
EricSinsky-NOAA Jul 23, 2024
65a7ab7
Replace Jinja namespaces with replace_tmpl filter and disable ACCOUNT…
DavidHuber-NOAA Jul 23, 2024
8486596
Refactoring of the marine B-matrix job (#2749)
guillaumevernieres Jul 24, 2024
a7f6b32
Temporarily disable METplus jobs (#2796)
DavidHuber-NOAA Jul 25, 2024
f156a78
HR4 GWD update (#2732)
JessicaMeixner-NOAA Jul 26, 2024
61875f2
Remove f000 from atmos rocoto tasks for replay cases (#2778)
EricSinsky-NOAA Jul 29, 2024
1cf8b44
Simplify resource-related variables, remove CDUMP where unneeded (#2727)
DavidHuber-NOAA Jul 30, 2024
d3d85f0
Add fixes for metplus jobs when gfs_cyc=2 or 4 (#2791)
DavidHuber-NOAA Aug 1, 2024
aa2af1c
Update the gfs_utils repository hash (#2801)
GeorgeGayno-NOAA Aug 1, 2024
4987704
Update ocean post-processing triggers (#2784)
aerorahul Aug 2, 2024
b73b1fd
Fix erroneous cdump addition (#2803)
WalterKolczynski-NOAA Aug 2, 2024
0706c59
Update Java Agent launching script for Jenkins connections (#2762)
TerrenceMcGuinness-NOAA Aug 2, 2024
6d7f7e8
Run METplus serially and correct the name of prod tasks (#2804)
DavidHuber-NOAA Aug 2, 2024
d599fff
Change land surface for HR4 (#2787)
HelinWei-NOAA Aug 5, 2024
8fee36f
Clean-up temporary rundirs - take 2. (#2753)
aerorahul Aug 6, 2024
876dfee
Bugfix for updating label states in Jenkins (#2808)
TerrenceMcGuinness-NOAA Aug 6, 2024
37c53ac
Revert MSU FIX_DIRs back to glopara (#2811)
KateFriedman-NOAA Aug 7, 2024
7a79146
Marine DA updates (#2802)
guillaumevernieres Aug 7, 2024
5c2e9b1
Feature/get arch adds an empty archive job to GEFS system (#2772)
AntonMFernando-NOAA Aug 7, 2024
ad8d3e9
Check that a PR driver is still running before trying to kill it (#2799)
DavidHuber-NOAA Aug 7, 2024
e2c0f06
Stage atmospheric backgrounds and UFS cubed-sphere history files (#2792)
DavidNew-NOAA Aug 8, 2024
1d53953
Add capability to run forecast in segments (#2795)
WalterKolczynski-NOAA Aug 12, 2024
5699167
Add fixes to products for when REPLAY IC's are used (#2755)
EricSinsky-NOAA Aug 13, 2024
eba813f
Add support for forecast-only runs on AWS (#2711)
weihuang-jedi Aug 13, 2024
f2aee0a
Add Gaea C5 to CI (#2814)
AnilKumar-NOAA Aug 13, 2024
d994642
Jenkins Pipeline Updates (#2815)
TerrenceMcGuinness-NOAA Aug 13, 2024
336b78a
Hotfix: Handle UNAVAILABLE and UNKNOWN rocoto status in Bash CI (#2820)
DavidHuber-NOAA Aug 13, 2024
8772e61
Fixed test on UNAVAILBLE in python Rocoto check (#2842)
TerrenceMcGuinness-NOAA Aug 20, 2024
659bcbe
Convert staging job to python and yaml (#2651)
KateFriedman-NOAA Aug 20, 2024
1b18f2f
support ATM forecast only on Azure (#2827)
weihuang-jedi Aug 20, 2024
2ce2116
Add snow DA update and recentering for the EnKF forecasts (#2690)
CoryMartin-NOAA Aug 23, 2024
ea22a73
Update omega calculation (#2751)
XiaqiongZhou-NOAA Aug 23, 2024
1231c9a
Add GEFS C48 support on AWS (#2818)
weihuang-jedi Aug 26, 2024
7a724e0
Support ATM forecast only on Google (#2832)
weihuang-jedi Aug 26, 2024
935ac64
Fix gdas build on Gaea and add Gaea to available CI list (#2857)
AnilKumar-NOAA Aug 27, 2024
9ad7d3e
Add JEDI ATM lgetkf observer and solver jobs (#2833)
RussTreadon-NOAA Aug 28, 2024
85c7659
Support coupling on AWS (#2859)
weihuang-jedi Aug 28, 2024
5ccdd8b
Correct ocean `MOM.res_#` stage copy (#2868)
KateFriedman-NOAA Aug 29, 2024
7f160f6
Add diffusion/diag B for aerosol DA and some other needed changes (#2…
CoryMartin-NOAA Aug 29, 2024
66fc89c
Add 3 and 9 hr increment files to IC staging (#2876)
AndrewEichmann-NOAA Aug 30, 2024
5c304b5
Support global-workflow GEFS C48 on Google Cloud (#2861)
weihuang-jedi Sep 4, 2024
2e4f4b7
Add ability to run CI test C96_atm3DVar.yaml to Gaea-C5 (#2885)
DavidBurrows-NCO Sep 4, 2024
d3ea8e2
Update aerosol climatology to 2013-2024 mean (#2888)
AnningCheng-NOAA Sep 6, 2024
6519211
Eliminate race conditions and remove DATAROOT last in cleanup (#2893)
DavidHuber-NOAA Sep 6, 2024
ac93a9b
Reenable Orion Cycling Support (#2877)
DavidHuber-NOAA Sep 7, 2024
2816c3b
Add an archive task to GEFS system to archive files locally (#2816)
AntonMFernando-NOAA Sep 7, 2024
b8080cd
Restructure the bufr sounding job (#2853)
BoCui-NOAA Sep 7, 2024
49f697a
Create JEDI class (#2805)
DavidNew-NOAA Sep 7, 2024
0953c0f
Add FAQ page and a caution with using reserved variables (#2898)
aerorahul Sep 9, 2024
b443915
Consolidate python configuration dictionaries (#2839)
DavidHuber-NOAA Sep 10, 2024
6ea681b
Replace APRUN with APRUN_default (#2871)
DavidHuber-NOAA Sep 11, 2024
108db4d
Add new UPP links to .gitignore (#2904)
DavidHuber-NOAA Sep 12, 2024
4ad9695
Disable native grid writes for non-JEDI experiments; update C384 comp…
aerorahul Sep 13, 2024
d866982
Support gefs C48 on Azure (#2881)
weihuang-jedi Sep 13, 2024
19455ba
add 1 deg ocean/ice info to parm/config/gfs/config.resources (#2922)
jswhit2 Sep 14, 2024
a13bbef
Build GDASApp and unset memory in Gaea-C5 xml files (#2912)
DavidBurrows-NCO Sep 14, 2024
b7f71e0
Cleanup job for GEFS (#2919)
AntonMFernando-NOAA Sep 14, 2024
03ee9f8
Update config.resources for bufr sounding job postsnd (#2917)
BoCui-NOAA Sep 16, 2024
2602eac
Update global atmos upp job to use COMIN/COMOUT (#2867)
mingshichen-noaa Sep 16, 2024
7588d2b
Update to obsproc/v1.2.0 and prepobs/v1.1.0 (#2903)
KateFriedman-NOAA Sep 18, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
11 changes: 11 additions & 0 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,17 @@
# Change characteristics
- Is this a breaking change (a change in existing functionality)? YES/NO
- Does this change require a documentation update? YES/NO
- Does this change require an update to any of the following submodules? YES/NO (If YES, please add a link to any PRs that are pending.)
- [ ] EMC verif-global
- [ ] GDAS
- [ ] GFS-utils
- [ ] GSI
- [ ] GSI-monitor
- [ ] GSI-utils
- [ ] UFS-utils
- [ ] UFS-weather-model
- [ ] wxflow


# How has this been tested?
<!-- Please list any test you conducted, including the machine.
Expand Down
64 changes: 64 additions & 0 deletions .github/workflows/ci_unit_tests.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
name: CI Unit Tests
on: [pull_request, push, workflow_dispatch]

jobs:

ci_pytest:
runs-on: ubuntu-latest
name: Run unit tests on CI system
permissions:
checks: write

steps:
- name: Checkout code
uses: actions/checkout@v4

- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: 3.11.8

- name: Install dependencies
run: |
sudo apt-get update
sudo apt-get install -y perl libxml-libxml-perl libxml-libxslt-perl libdatetime-perl
python -m pip install --upgrade pip
pip install pytest
pip install wxflow
pip install wget

- name: Cache Rocoto Install
uses: actions/cache@v4
with:
path: ~/rocoto
key: ${{ runner.os }}-rocoto-${{ hashFiles('**/ci-unit_tests.yaml') }}

- name: Install Rocoto
run: |
if [ ! -d "$HOME/rocoto/bin" ]; then
git clone https://github.com/christopherwharrop/rocoto.git $HOME/rocoto
cd $HOME/rocoto
./INSTALL
fi
echo "$HOME/rocoto/bin" >> $GITHUB_PATH

- name: Run tests
shell: bash
run: |
sudo mkdir -p /scratch1/NCEPDEV
cd $GITHUB_WORKSPACE/sorc
git submodule update --init
./link_workflow.sh
cd $GITHUB_WORKSPACE/ci/scripts/tests
ln -s ../wxflow

pytest -v --junitxml $GITHUB_WORKSPACE/ci/scripts/tests/test-results.xml


- name: Publish Test Results
if: always()
uses: EnricoMi/publish-unit-test-result-action@v2
with:
files: ci/scripts/tests/test-results.xml
job_summary: true
comment_mode: off
56 changes: 17 additions & 39 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,10 @@ fix/gsi
fix/lut
fix/mom6
fix/orog
fix/orog_nest
fix/sfc_climo
fix/ugwd
fix/ugwd_nest
fix/verif
fix/wave

Expand All @@ -51,11 +53,8 @@ parm/gdas/soca
parm/gdas/jcb-gdas
parm/gdas/jcb-algorithms
parm/monitor
parm/post/AEROSOL_LUTS.dat
parm/post/nam_micro_lookup.dat
parm/post/optics_luts_DUST.dat
parm/post/gtg.config.gfs
parm/post/gtg_imprintings.txt
parm/post/optics_luts_DUST_nasa.dat
parm/post/optics_luts_NITR_nasa.dat
parm/post/optics_luts_SALT.dat
Expand All @@ -68,51 +67,19 @@ parm/post/optics_luts_WASO.dat
parm/post/optics_luts_WASO_nasa.dat
parm/post/params_grib2_tbl_new
parm/post/post_tag_gfs128
parm/post/post_tag_gfs65
parm/post/postcntrl_gefs.xml
parm/post/postcntrl_gefs_aerosol.xml
parm/post/postcntrl_gefs_anl.xml
parm/post/postcntrl_gefs_chem.xml
parm/post/postcntrl_gefs_f00.xml
parm/post/postcntrl_gfs.xml
parm/post/postcntrl_gfs_anl.xml
parm/post/postcntrl_gfs_f00.xml
parm/post/postcntrl_gfs_f00_two.xml
parm/post/postcntrl_gfs_flux.xml
parm/post/postcntrl_gfs_flux_f00.xml
parm/post/postcntrl_gfs_goes.xml
parm/post/postcntrl_gfs_goes.xml-new
parm/post/postcntrl_gfs_two.xml
parm/post/postcntrl_gfs_wafs.xml
parm/post/postcntrl_gfs_wafs_anl.xml
parm/post/postxconfig-NT-GEFS-ANL.txt
parm/post/postxconfig-NT-GEFS-F00.txt
parm/post/postxconfig-NT-GEFS-F00-aerosol.txt
parm/post/postxconfig-NT-GEFS-WAFS.txt
parm/post/postxconfig-NT-GEFS-aerosol.txt
parm/post/postxconfig-NT-GEFS.txt
parm/post/postxconfig-NT-GFS-ANL.txt
parm/post/postxconfig-NT-GFS-F00-TWO.txt
parm/post/postxconfig-NT-GFS-F00.txt
parm/post/postxconfig-NT-GFS-FLUX-F00.txt
parm/post/postxconfig-NT-GFS-FLUX.txt
parm/post/postxconfig-NT-GFS-GOES.txt
parm/post/postxconfig-NT-GFS-TWO.txt
parm/post/postxconfig-NT-GFS-WAFS-ANL.txt
parm/post/postxconfig-NT-GFS-WAFS.txt
parm/post/postxconfig-NT-GFS.txt
parm/post/postxconfig-NT-gefs-aerosol.txt
parm/post/postxconfig-NT-gefs-chem.txt
parm/post/gfs
parm/post/gefs
parm/post/ocean.csv
parm/post/ice.csv
parm/post/ocnicepost.nml.jinja2
parm/ufs/noahmptable.tbl
parm/ufs/model_configure.IN
parm/ufs/model_configure_nest.IN
parm/ufs/input_global_nest.nml.IN
parm/ufs/MOM_input_*.IN
parm/ufs/MOM6_data_table.IN
parm/ufs/ice_in.IN
parm/ufs/ufs.configure.*.IN
parm/ufs/post_itag_gfs
parm/wafs

# Ignore sorc and logs folders from externals
Expand Down Expand Up @@ -164,6 +131,14 @@ scripts/exemcsfc_global_sfc_prep.sh
scripts/exgdas_global_marine_analysis_ecen.py
scripts/exglobal_prep_ocean_obs.py
# ush symlinks
ush/bufr2ioda_insitu_profile_argo.py
ush/bufr2ioda_insitu_profile_bathy.py
ush/bufr2ioda_insitu_profile_glider.py
ush/bufr2ioda_insitu_profile_marinemammal.py
ush/bufr2ioda_insitu_profile_tesac.py
ush/bufr2ioda_insitu_profile_xbtctd.py
ush/bufr2ioda_insitu_surface_altkob.py
ush/bufr2ioda_insitu_surface_trkob.py
ush/chgres_cube.sh
ush/emcsfc_ice_blend.sh
ush/emcsfc_snow.sh
Expand All @@ -174,6 +149,8 @@ ush/fv3gfs_make_grid.sh
ush/fv3gfs_make_orog.sh
ush/gen_bufr2ioda_json.py
ush/gen_bufr2ioda_yaml.py
ush/bufr2ioda_insitu_profile*.py
ush/bufr2ioda_insitu_surface*.py
ush/global_chgres.sh
ush/global_chgres_driver.sh
ush/global_cycle.sh
Expand All @@ -188,6 +165,7 @@ ush/month_name.sh
ush/imsfv3_scf2ioda.py
ush/atparse.bash
ush/run_bufr2ioda.py
ush/bufr2ioda_insitu*

# version files
versions/build.ver
Expand Down
8 changes: 0 additions & 8 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -26,11 +26,3 @@
[submodule "sorc/gsi_monitor.fd"]
path = sorc/gsi_monitor.fd
url = https://github.com/NOAA-EMC/GSI-Monitor.git
[submodule "sorc/upp.fd"]
path = sorc/upp.fd
url = https://github.com/NOAA-EMC/UPP.git
ignore = dirty
[submodule "sorc/jcb"]
path = sorc/jcb
url = https://github.com/noaa-emc/jcb
fetchRecurseSubmodules = false
Loading
Loading