issue with loading dataset

[orgw]

Hi! Thanks for the code and data.

can you please provide some guideline regarding bringing the dataset from huggingface? I'm having some issues. Specifically, dataset schema doesn't align with the expected data structure, can you validate if it's properly working?

I've run

dataset = load_dataset("andrewt28/MolLM-dataset", cache_dir="/data/mollm_dataset") and returns

TypeError: Couldn't cast array of type
struct<MoveToTop: bool, CreateTable: struct<FromInformationIn: string, NumberOfColumns: int64, ColumnContents: list<item: string>, ColumnHeadings: list<item: string>>, ShowAtMost: int64, HideThisSection: bool, ListType: string>
to
{'MoveToTop': Value(dtype='bool', id=None), 'HideThisSection': Value(dtype='bool', id=None), 'CreateTable': {'FromInformationIn': Value(dtype='string', id=None), 'NumberOfColumns': Value(dtype='int64', id=None), 'ColumnHeadings': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None), 'ColumnContents': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None)}, 'ShowAtMost': Value(dtype='int64', id=None)}

The above exception was the direct cause of the following exception: