Hugging Face datasets

Hugging Face datasets

🔘 Laboratory page: github.com/huggingface/datasets

Summary

“Datasets is a lightweight library providing two main features:
– One-line dataloaders for many public datasets: one liners to download and pre-process any of the number of datasets major public datasets (in 467 languages and dialects!) provided on the HuggingFace Datasets Hub and,
– An efficient data pre-processing: simple, fast and reproducible data pre-processing for the above public datasets as well as your own local datasets in CSV/JSON/text.”



Author

Hugging Face. “The AI community building the future. (Build, train and deploy state of the art models powered by the reference open source in natural language processing).Research interests: solving NLP, one commit at a time”. About they and join this org: https://huggingface.co/huggingface

#R0identifier=”9aa989eb74fe4c887ef303fbc654f681″
Click to rate this post
[Total: 2 Average: 5]

Liked this post? Follow this blog to get more.