Hugging Face Datasets

E435888

Hugging Face Datasets is an open-source library that provides a large collection of ready-to-use datasets and efficient data loading tools for machine learning and natural language processing workflows.

All labels observed (3)

How this entity was disambiguated

Statements (52)

Predicate Object
instanceOf Python library
data processing framework
machine learning tool
open-source software
software library
compatibleWith Hugging Face Tokenizers
Hugging Face Transformers
JAX
NumPy
Pandas
linked to: pandas

PyTorch
TensorFlow
developer Hugging Face
documentation https://huggingface.co/docs/datasets
feature arrow-based storage
dataset caching
dataset card metadata
dataset streaming from hub
dataset versioning
filtering
integration with Hugging Face Hub
load from hub
map-style transforms
memory-mapped datasets
on-the-fly preprocessing
parquet export
push to hub
ready-to-use datasets
sharding and batching
streaming data loading
train-test-validation splits
hasComponent datasets library
datasets server-side tooling
license Apache License 2.0
offers community-contributed datasets
curated benchmark datasets
dataset loading scripts
partOf Hugging Face ecosystem
programmingLanguage Python
Rust
repository https://github.com/huggingface/datasets
supportsTask audio processing
computer vision
machine learning
multimodal learning
natural language processing
typicalUse benchmarking
data preprocessing
dataset exploration
model evaluation
model training
usesFormat Apache Arrow

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers compatibleWith Hugging Face Datasets
Hugging Face notableProduct Datasets library
linked to: Hugging Face Datasets
Hugging Face Datasets repository https://github.com/huggingface/datasets
linked to: Hugging Face Datasets
Hugging Face Accelerate integratesWith Hugging Face Datasets