User-defined filters for HDF5 #1391
-
Hello, I wanted to use the ucar.nc2.filter package to read an LZ4 compressed dataset from an HDF5 file and I've been following the steps described for Zarr files here. I run into the following error:
Looking at H5tiledLayoutBB, it looks like any filter other than deflate, shuffle and fletcher32 would throw a RuntimeException? I'm using v5.6.0. The issue seems related to this other discussion here. Did I misunderstand something about user-defined filters and the HDF5 IOSP? Thank you in advance! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
The issue was that to open the file I called
I think there still are two implementation of the hdf5 iosp and this deprecated method goes to the old one, through
instead. This will then go to |
Beta Was this translation helpful? Give feedback.
The issue was that to open the file I called
NetcdfFile file = NetcdfFile.open(filePath);
I think there still are two implementation of the hdf5 iosp and this deprecated method goes to the old one, through
ucar.nc2.iosp.hdf5.H5tiledLayoutBB
. To use the implementation that handles filters with the ucar.nc2.filter package, it was sufficient to open the file withNetcdfFile file = NetcdfFiles.open(filePath);
instead. This will then go to
ucar.nc2.internal.iosp.hdf5.H5tiledLayoutBB
and the new implementation, which works as expected.