You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, only bytes and crc32c are supported. Other codecs will have an impact on the compressed size of the index, which needs to be calculated based on the codecs present.
I guess this works for most datasets, but not for all. Although, it doesn't make a lot of sense, it is spec-compliant to have multiple crc32c checksums. In the future, there might be other codecs that change the size of the shard index.
A more correct way would be to compute the size of the index based on the entire index_codecs pipeline. zarrita uses for that the compute_encoded_size methods.
The text was updated successfully, but these errors were encountered:
Currently, only bytes and crc32c are supported. Other codecs will have an impact on the compressed size of the index, which needs to be calculated based on the codecs present.
Raised in #7553
The text was updated successfully, but these errors were encountered: