Skip to content

Parquet Sink v0.2.0

Compare
Choose a tag to compare
@fracek fracek released this 21 Aug 15:27

This release improves the developer experience when running locally.

Added

  • Add a --persist-to-fs=my-dir flag to persist the indexer's state to the
    filesystem. This option creates a new directory (specified by the user) and
    writes the indexer's current state to a file, with one file per indexer.
    Developers shouldn't use this option for production, but only for
    development since it lacks any locking mechanism to prevent multiple copies
    of the same indexer running at the same time.

Changed

  • The transform function now is invoked with a single block of data.