History output of CTSM data that NEON will be hosting

[wwieder]

NEON needs to determine what data they want and how to share it.

If we're providing 30 minute data from simulations that are run updated every month then CTSM history files will likely needed to have daily history files (with 48 time steps) for consistency.

[wwieder]

Somewhat related to visualization #1355, we discussed:

• Using a shiny app to visualize the data on the NEON side?
• ESDS has also talked about providing more interactive ways to visualize the data.
• @briandobbins is this something being considered in CESM-lab?
• @negin513 how involved would it be to start building a package that allows for a more interactive way to visualize data?
• a super basic example for soils data can be seen here

[wwieder]

What data do we want NEON to host? List of CLM variables

[wwieder]

Suggested list of 17 variables that NEON will host can be found at this link

@negin513 and @jedwards4b, what's the best way to make these the 'standard' output for one of the CLM history fields written at 30 minute time steps:

• recalling that we'll be providing new datasets monthly, are these best written out every day?
• should this be accomplished in the wrapper script that @negin513 is working on?
• Is this enough to figure out how we're going to push these data back to NEON, @jedwards4b ?

[jedwards4b]

This should be put into the ctsm/cime_config/usermods_dirs/NEON/defaults/user_nl_clm

…

On Wed, Jul 14, 2021 at 4:57 PM will wieder ***@***.***> wrote: Suggested list of *17 variables* that NEON will host can be found at this link <https://docs.google.com/spreadsheets/d/1F9xWF0Ql8ZnWZT1StK43Bbiq9jX85zHA33VNE_QHbps/edit?usp=sharing> @negin513 <https://github.com/negin513> and @jedwards4b <https://github.com/jedwards4b>, what's the best way to make these the 'standard' output for one of the CLM history fields written at 30 minute time steps: - recalling that we'll be providing new datasets monthly, are these best written out every day? - should this be accomplished in the wrapper script that @negin513 <https://github.com/negin513> is working on? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1376 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABOXUGDQVHQSR7INJEEM34LTXYI5HANCNFSM45DEYZJA> .

-- Jim Edwards CESM Software Engineer National Center for Atmospheric Research Boulder, CO

[jedwards4b]

I will do that.

…

On Thu, Jul 15, 2021 at 7:07 AM Jim Edwards ***@***.***> wrote: This should be put into the ctsm/cime_config/usermods_dirs/NEON/defaults/user_nl_clm On Wed, Jul 14, 2021 at 4:57 PM will wieder ***@***.***> wrote: > Suggested list of *17 variables* that NEON will host can be found at > this link > <https://docs.google.com/spreadsheets/d/1F9xWF0Ql8ZnWZT1StK43Bbiq9jX85zHA33VNE_QHbps/edit?usp=sharing> > > @negin513 <https://github.com/negin513> and @jedwards4b > <https://github.com/jedwards4b>, what's the best way to make these the > 'standard' output for one of the CLM history fields written at 30 minute > time steps: > > - recalling that we'll be providing new datasets monthly, are these > best written out every day? > - should this be accomplished in the wrapper script that @negin513 > <https://github.com/negin513> is working on? > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <#1376 (comment)>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/ABOXUGDQVHQSR7INJEEM34LTXYI5HANCNFSM45DEYZJA> > . > -- Jim Edwards CESM Software Engineer National Center for Atmospheric Research Boulder, CO

-- Jim Edwards CESM Software Engineer National Center for Atmospheric Research Boulder, CO

[jedwards4b]

@wwieder here is a sample of the output file: /glade/scratch/jedwards/archive/NEON-JERC/lnd/hist/NEON-JERC.clm2.h1.2018-01-02-00000.nc

[wwieder]

This looks good @jedwards4b. What frequency are we writing out these data (how many time steps / history file)? I don't really have a preference, but want to make it easy to continually update simulations when new met data are available from NEON.

Do you want to add this to ctsm/cime_config/usermods_dirs/NEON/defaults/user_nl_clm and include it in your current PR, #1411?

[jedwards4b]

Yes, I will add it to the PR. I'm writing every 1/2 hr and putting 1 day (48 timesteps) per history file.

…

On Thu, Jul 15, 2021 at 10:05 AM will wieder ***@***.***> wrote: This looks good @jedwards4b <https://github.com/jedwards4b>. What frequency are we writing out these data (how many time steps / history file)? I don't really have a preference, but want to make it easy to continually update simulations when new met data are available from NEON. Do you want to add this to ctsm/cime_config/usermods_dirs/NEON/defaults/user_nl_clm and include it in your current PR? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1376 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABOXUGGEDKM6EA4MQDSAT5TTX4BL7ANCNFSM45DEYZJA> .

-- Jim Edwards CESM Software Engineer National Center for Atmospheric Research Boulder, CO