Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update build environment files for Hera, Orion, WCOSS with latest hpc-stack #138

Merged
merged 13 commits into from
May 13, 2021
Merged

Update build environment files for Hera, Orion, WCOSS with latest hpc-stack #138

Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f94c85e
Update the build enviroment
chan-hoo May 5, 2021
d3e5a23
Update the build environment for wcoss dell
chan-hoo May 5, 2021
d6fe3c6
Update the build environment for wcoss cray
chan-hoo May 5, 2021
4fc7c1c
Update the build environment for Hera
chan-hoo May 5, 2021
6477e91
Update hash of regional workflow
chan-hoo May 5, 2021
7a32f67
Update build environment for Hera
chan-hoo May 5, 2021
dfad488
Update build environment for Orion
chan-hoo May 5, 2021
28fd511
Re-order modules
chan-hoo May 5, 2021
f416091
Update module list for wcoss dell
chan-hoo May 5, 2021
93db64e
Update module list for wcoss dell
chan-hoo May 5, 2021
38fdb07
back to the original hash
chan-hoo May 6, 2021
264d533
Rearrange modules in alphabetical order
chan-hoo May 6, 2021
232a32a
Remove unnecessary modules
chan-hoo May 11, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 22 additions & 18 deletions env/build_hera_intel.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,42 +2,46 @@

module purge

module load cmake/3.16.1
Copy link
Collaborator

@JeffBeck-NOAA JeffBeck-NOAA May 6, 2021 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should # UFS_UTILS be listed above these two modules? HPSS is only used for the exregional_get_extrn_mdl_files.sh script and cmake is for everything (comment applies to all environment files).

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JeffBeck-NOAA, The comment means the order of UFS_UTILS -> ufs-weather-model -> EMC_post (order in Externals.cfg). It doesn't mean a specific component. This is the reason why I put '+' before EMC_post or ufs-weather-model in comments (for example, # + EMC_post). I used it as an indicator of 'in addition'. If you think these comments make users confused, I'll remove all the comments and rearrange the modules in the alphabetical order.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @chan-hoo. I'm honestly still confused, but it could just be me. I was thinking they were block headers that represent which modules apply to which App component. How do they represent the Externals.cfg file?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JeffBeck-NOAA, I've removed all the comments about components and rearranged modules only in alphabetical order. I'll test building on each machine again.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JeffBeck-NOAA, completed!

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @chan-hoo! This looks good to me. Going to approve, but would like to have @mkavulich's review as well.

module load hpss
module use /contrib/sutils/modulefiles
module load sutils
module load cmake/3.16.1

module use /scratch2/NCEPDEV/nwprod/hpc-stack/test/modulefiles/stack

module load hpc/1.0.0-beta1
### hpc-stack ###
module use /scratch2/NCEPDEV/nwprod/hpc-stack/libs/hpc-stack/modulefiles/stack
module load hpc/1.1.0
module load hpc-intel/18.0.5.274
module load hpc-impi/2018.0.4
module load jasper/2.0.22
module load zlib/1.2.11
module load png/1.6.35
module load hdf5/1.10.6
module load netcdf/4.7.4
module load pio/2.5.1
module load esmf/8_1_0_beta_snapshot_27

module load bacio/2.4.1
module load crtm/2.3.0
module load gfsio/1.4.1
module load g2/3.4.1
module load g2tmpl/1.9.1
module load g2tmpl/1.10.0
module load ip/3.3.3
module load jasper/2.0.22
module load nemsio/2.5.2
module load png/1.6.35
module load sfcio/1.4.1
module load sigio/2.3.2
module load sp/2.3.3
module load w3emc/2.7.3
module load wgrib2/2.0.8
module load w3nco/2.4.1
module load upp/10.0.0
module load zlib/1.2.11

module load gfsio/1.4.1
module load sfcio/1.4.1
### Additional modules ###
module load esmf/8_1_0_beta_snapshot_27
chan-hoo marked this conversation as resolved.
Show resolved Hide resolved
module load hdf5/1.10.6
module load landsfcutil/2.4.1
module load nccmp/1.8.7.0
module load nemsiogfs/2.5.3
module load wgrib2/2.0.8
module load netcdf/4.7.4
module load upp/10.0.0
module load wrf_io/1.1.1
chan-hoo marked this conversation as resolved.
Show resolved Hide resolved
module load w3emc/2.7.3


export CMAKE_C_COMPILER=mpiicc
export CMAKE_CXX_COMPILER=mpiicpc
export CMAKE_Fortran_COMPILER=mpiifort
export CMAKE_Platform=hera.intel

39 changes: 24 additions & 15 deletions env/build_orion_intel.env
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,40 +1,49 @@
#Setup instructions for MSU Orion using Intel-18.0.5 (bash shell)

module load contrib noaatools
module purge

module load cmake/3.17.3
module load contrib noaatools
module load python/3.7.5

module use /apps/contrib/NCEP/test/hpc-stack-nco/modulefiles/stack

module load hpc/1.0.0-beta1
### hpc-stack ###
module use /apps/contrib/NCEP/libs/hpc-stack/modulefiles/stack
module load hpc/1.1.0
module load hpc-intel/2018.4
module load hpc-impi/2018.4

module load jasper/2.0.22
module load zlib/1.2.11
module load png/1.6.35
module load hdf5/1.10.6
module load netcdf/4.7.4
module load pio/2.5.1
module load esmf/8_1_0_beta_snapshot_27
module load bacio/2.4.1
module load crtm/2.3.0
module load gfsio/1.4.1
module load g2/3.4.1
module load g2tmpl/1.9.1
module load ip/3.3.3
module load jasper/2.0.22
module load nemsio/2.5.2
module load png/1.6.35
module load sfcio/1.4.1
module load sigio/2.3.2
module load sp/2.3.3
module load wgrib2/2.0.8
module load wrf_io/1.1.1
module load w3emc/2.7.3
module load w3nco/2.4.1
module load upp/10.0.0
module load zlib/1.2.11

module load gfsio/1.4.1
module load sfcio/1.4.1
### Additional modules ###
module load esmf/8_1_0_beta_snapshot_27
module load hdf5/1.10.6
module load landsfcutil/2.4.1
module load nccmp/1.8.7.0
module load nemsiogfs/2.5.3
module load wgrib2/2.0.8
module load netcdf/4.7.4
module load upp/10.0.0
module load wrf_io/1.1.1
chan-hoo marked this conversation as resolved.
Show resolved Hide resolved
module load w3emc/2.7.3


export CMAKE_C_COMPILER=mpiicc
export CMAKE_CXX_COMPILER=mpiicpc
export CMAKE_Fortran_COMPILER=mpiifort
export CMAKE_Platform=orion.intel

11 changes: 5 additions & 6 deletions env/build_wcoss_cray_intel.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,29 +26,28 @@ export PNG_ROOT="/usrx/local/prod//png/1.2.49/intel/sandybridge"
module use /usrx/local/nceplibs/NCEPLIBS/cmake/install/NCEPLIBS-v1.3.0/modules
module load bacio/2.4.1
module load crtm/2.3.0
module load gfsio/1.4.1
module load g2/3.4.1
module load g2tmpl/1.9.1
module load ip/3.3.3
module load nemsio/2.5.2
module load sfcio/1.4.1
module load sigio/2.3.2
module load sp/2.3.3
module load upp/10.0.4
module load w3emc/2.7.3
module load w3nco/2.4.1
module load upp/10.0.0
module load gfsio/1.4.1
module load sfcio/1.4.1
module load sigio/2.3.2
module load landsfcutil/2.4.1
module load nemsiogfs/2.5.3
module load wgrib2/2.0.8

module use /gpfs/hps3/emc/nems/noscrub/emc.nemspara/soft/modulefiles
module load esmf/8.1.0bs27

module swap pmi pmi/5.0.11

## load cmake
export CMAKE_C_COMPILER=cc
export CMAKE_CXX_COMPILER=CC
export CMAKE_Fortran_COMPILER=ftn
export CMAKE_Platform=wcoss_cray


39 changes: 22 additions & 17 deletions env/build_wcoss_dell_p3_intel.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,40 +2,45 @@

module purge

module load cmake/3.16.2
module load HPSS/5.0.2.5
module load ips/18.0.1.163
module load impi/18.0.1
module load lsf/10.1
module load python/3.6.3
module load cmake/3.16.2

module use /usrx/local/nceplibs/dev/hpc-stack/test/hpc-stack/modulefiles/stack

module load hpc/1.0.0-beta1
### hpc-stack ###
module use /usrx/local/nceplibs/dev/hpc-stack/libs/hpc-stack/modulefiles/stack
module load hpc/1.1.0
module load hpc-ips/18.0.1.163
module load hpc-impi/18.0.1
module load jasper/2.0.22
module load zlib/1.2.11
module load png/1.6.35
module load hdf5/1.10.6
module load netcdf/4.7.4
module load pio/2.5.1
module load esmf/8_1_0_beta_snapshot_27

module load bacio/2.4.1
module load crtm/2.3.0
module load gfsio/1.4.1
module load g2/3.4.1
module load g2tmpl/1.9.1
module load g2tmpl/1.10.0
module load ip/3.3.3
module load nemsio/2.5.2
module load jasper/2.0.22
module load png/1.6.35
module load sfcio/1.4.1
module load sigio/2.3.2
module load sp/2.3.3
module load w3emc/2.7.3
module load w3nco/2.4.1
module load upp/10.0.0
module load zlib/1.2.11

module load gfsio/1.4.1
module load sfcio/1.4.1
# Additional modules
module load esmf/8_1_0_beta_snapshot_27
module load hdf5/1.10.6
module load landsfcutil/2.4.1
module load nccmp/1.8.7.0
module load nemsio/2.5.2
module load nemsiogfs/2.5.3
module load netcdf/4.7.4
module load upp/10.0.4
module load wgrib2/2.0.8
module load wrf_io/1.1.1
module load w3emc/2.7.3


export CMAKE_C_COMPILER=mpiicc
Expand Down