-
Notifications
You must be signed in to change notification settings - Fork 262
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Writing using hyperslabs is extremely slow compared to netCDF-C #1222
Comments
Can we see your C code? The python interface uses |
I see what is going on - we had added a workaround for the slowness of |
Thanks @jswhit for taking a look. If it is needed, I can convert my MATLAB code to C repro. |
No need for the C code @abhibaruah. PR #1224 should solve it - if you can give it a try and verify that it does that would be great. |
Tested it on my repro. The timing came down from 100+ seconds to ~8 seconds. |
closed by PR #1124 |
netCDF4 version = 1.6.1
netCDF4 hdf5libversion = 1.12.1
netCDF4 netcdf4libversion = 4.8.1
OS: Windows 10
I am trying to create a netCDF4 file and write to it using hyperslabs. However, the writing is extremely slow. The repro code that I posted below takes over 100 seconds. The same workflow using netCDF-C takes a maximum of 10 seconds.
In the repro code below, if I change the 'stride' and 'count' to be (1,1,1) and (400,400,400) respectively, the repro takes < 10 sec.
Is this expected with hyperslab writing or some kind of performance bug?
The text was updated successfully, but these errors were encountered: