-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
xarray backend for reading tdlpack files (#9)
* backend appears to be working for reading gridded sq tdlpack files more TdlpackBackend work, got station reads working and fixed few issues remove _normalize_path from import add tdlpack as xarray.backend entry point coerce zero time to NaT instead of erroring when reading constant data without date account for variable that consists of one record and use equals method for comparison store only file name for thread safety and enables opening in parralel added date and lead to preferred chunks fixed issue with handling the length one slice Revert "added date and lead to preferred chunks" This reverts commit cb9b2b3. clean up prints re-organized geography handling in open_dataset so that many variables open faster performance improvements; including fastpath when file has multiple identical station records, like when tdlp files are catted keep only print about what is being loaded fix selection of sta record from file 9999.0 to nan; sort stations; fix threshold parsing and type as float fix for station sort values MINPK default to 21 and use nx and ny from is2 when packing grids instead of nx and ny attrs new ability to write back to tdlpack with da|ds.tdlp.to_tdlpack use .size to determin len 1 coords temporarily include patch for removing small station records as they are not working handle unsorted station lists properly, albeit slow, data is no longer wrong when dealing with unsorted station lists in tdlpack file introduce some basic tests for TdlpackBackend refactor filtering, correct writing to tdlpack with more coords, cleanup, add tests set primary missing in template writing record to 9999.0, so nans are converted to missing value on tdlpack; introduced automatic dec_scale preciosn logic based on number of unique values in range of data fix var usage account for records with all missing when writing fix handling of missings and constant value arrays extra creanup and logging * correct writing when coord has single element Co-authored-by: Eric Engle <eengl@users.noreply.github.com>
- Loading branch information
1 parent
ede043d
commit efc3c7f
Showing
8 changed files
with
1,177 additions
and
66 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Oops, something went wrong.