Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Initial Parquet File/Dataset abstraction (#501)
Prep work for being able to fetch metadata from a bunch of Parquet files in a folder and load a spatial filter ### Change list - New `ParquetFile` and `ParquetDataset` Rust structs to read from one or multiple Parquet files. This is generic over `AsyncFileReader`, which primarily works with object store. - Added initial metadata handling, to e.g. read the bounding box of the file. - Added Python bindings to each class. This uses ObjectStore. - Added initial JS bindings to each class. This uses a custom implementation of `AsyncFileReader` [vendored from parquet-wasm](https://github.com/kylebarron/parquet-wasm/blob/0ecad6e1d87a377051087122f7ee2db52a2d6533/src/reader_async.rs). I couldn't get the ObjectStore integration working just yet. Thought object_store_wasm_s3 was updated and that might be an interesting thing to check out.
- Loading branch information