Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to use global average of terrain standard deviation on surfdata files #450

Closed
ekluzek opened this issue Jul 26, 2018 · 5 comments
Assignees
Labels
enhancement new capability or improved behavior of existing capability

Comments

@ekluzek
Copy link
Collaborator

ekluzek commented Jul 26, 2018

We talked about this in this mornings CTSM meeting. We'd like to add an option to use the global average of terrain standard deviation on surface datasets. This would be an option that starts at the creation of mapping files in mkmapdata. It then wouldn't run the 1km mapping files and hence would run much much quicker. Downstream from that it would just use a constant value (that we set as the global average).

This should be fairly easy to add in and would make the creation of mapping files much, much easier and faster and not requiring nearly as much memory.

@barlage @swensosc @billsacks

@ekluzek ekluzek added the enhancement new capability or improved behavior of existing capability label Jul 26, 2018
@ekluzek ekluzek self-assigned this Jul 26, 2018
@billsacks billsacks added the priority: high High priority to fix/merge soon, e.g., because it is a problem in important configurations label Aug 9, 2018
@billsacks
Copy link
Member

We discussed two other options at today's CTSM-software meeting, so now we're considering the following three options ((1) is the option discussed two weeks ago; (2) and (3) were options that, in today's discussion, we thought might be better):

  1. Use some average value for terrain standard deviation everywhere

  2. Skip putting this field on the surface dataset entirely, instead using a different parameterization for subgrid snow cover fraction that doesn't rely on this field

  3. Have a lower-resolution version of this file, if we could construct the remapping to give basically the same results from a lower-resolution file. (Note that right now the mapping is done by taking the standard deviation of 1km cells. If we went to a lower-resolution file, we'd presumably have to store the high-resolution standard deviation on that file, maybe in addition to the mean???)

@swensosc - this is becoming higher priority. Is this something you can give some thought to, to determine what would be the best path forward?

@ekluzek
Copy link
Collaborator Author

ekluzek commented Aug 10, 2018

FYI. OK, I added a fast option to mkmapdata.sh to run skipping the creation of the maps for the 1km file. I was able to send it using the default qcmd, giving it 2 hours of time, and it completed a single point mapping in about three and a half hours. This means the memory requirements are much lower, and if running with more than one processor we could cut the total time down as well.

@swensosc
Copy link
Contributor

std_elev.nmelt.pdf

@billsacks billsacks removed the priority: high High priority to fix/merge soon, e.g., because it is a problem in important configurations label Jul 15, 2019
@ekluzek
Copy link
Collaborator Author

ekluzek commented Nov 12, 2020

@swensosc comment here. #1198 (comment) recommends as a default that 20 be used. And also suggests that fmax could be set to zero.

I think this should still be done, because it will make creating mapping files very fast. Even with the improvements we are planning in the tool chain doing this is the best option to speed up the process dramatically.

@ekluzek
Copy link
Collaborator Author

ekluzek commented Sep 7, 2023

We have this in place in subset_data now already.

@ekluzek ekluzek closed this as completed Sep 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement new capability or improved behavior of existing capability
Projects
None yet
Development

No branches or pull requests

3 participants