Skip to content

rgrumbine/ice_scoring

Repository files navigation

ice_scoring

Tools for model evaluation, primarily of sea ice models.

Now includes, as submodules

Quick start:

  • Build the executables:
    • first build the mmablib -- cd ../mmablib; make
    • In the ice_scoring main directory ./makeall.sh
  • You'll also need the fixed files. Copy or use (ln -s):
    • WCOSS: /u/Robert.Grumbine/rgdev/fix
    • Hera: /home/Robert.Grumbine/rgdev/fix
    • Orion: /home/rgrumbin/rgdev/fix
  • For gross checks, more detail in gross_checks/README
    • python3 gross_ice.py NAME_OF_ICE.nc ctl/ice.extremes redone.dictionary
      • similarly for ocean.
    • there are a number of control (ctl) files, in order of least to highest frequency of output:
      • .extremes, .vvhigh, .vhigh, .high, .moderate
  • model scoring ... isn't a quick matter due to the many user and site-specific details. See main/README

Contents:

Directly skill-related:

  • main -- main .csh and python scripts to carry out model verification

  • drift -- ice drift skill metrics, oriented to the old drift model (sk2) using IABP for verification

    • these are relatively well-developed as metrics, see TN NNN, MMM for discussion
  • concentration -- metrics for measuring skill in sea ice concentration fields, the whole field, not just the edge

  • ice_edge -- find ice edge from an ice concentration analysis using transition against a tolerance

    • score a pair of ice edges
    • algorithms per discussions with Rick Allard (NRL) and Barbara Casati (ECCC)
  • thickness -- to be intercomparisons on sea ice thickness

  • integral

    • for ice area and extent, globally, hemispherically, and (in principle) within regions
    • integrated ice edge extent error (likewise, in principle)
  • gross_checks -- check for structural problems (grid seams) or impossible values (e.g. SST < -3)

Supportive:

  • fix -- fixed files -- binary files not on github. Copy or use (ln -s)

    • WCOSS: /u/Robert.Grumbine/rgdev/fix
    • Hera: /home/Robert.Grumbine/rgdev/fix
    • Orion: /home/rgrumbin/rgdev/fix
    • WCOSS2: /u/Robert.Grumbine/rgdev/fix (name will be lower case at some point)
  • nulls -- \t null forecasters

  • exec -- executables (not on git, generated by makeall.sh)

  • formats -- brief demonstrations of decoding various input file types and formats

  • legacy -- archive of codes used in support of papers 1994-2017.

Not in public github:

  • docs -- documents on ice model scoring

  • sidfex -- Sea Ice Dynamics Forecast Experiment support files/scripts

  • web -- towards web display of scores

About

Tools for model evaluation, primarily of sea ice models

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published