[Python] How to load a huggingface dataset from local path?

Discussão em 'Python' iniciado por Stack, Maio 8, 2025.

  1. Stack

    Stack Membro Participativo

    Take a simple example in this website, https://huggingface.co/datasets/Dahoas/rm-static:

    if I want to load this dataset online, I just directly use,

    from datasets import load_dataset
    dataset = load_dataset("Dahoas/rm-static")


    What if I want to load dataset from local path, so I download the files and keep the same folder structure from web Files and versions fristly,

    -data
    |-test-00000-of-00001-bf4c733542e35fcb.parquet
    |-train-00000-of-00001-2a1df75c6bce91ab.parquet
    -.gitattributes
    -README.md
    -dataset_infos.json


    Then, put them into my folder, but shows error when loading:

    dataset_path ="/data/coco/dataset/Dahoas/rm-static"
    tmp_dataset = load_dataset(dataset_path)


    It shows FileNotFoundError: No (supported) data files or dataset script found in /data/coco/dataset/Dahoas/rm-static.

    Continue reading...

Compartilhe esta Página