Hugging Face Accelerate

E435889

Hugging Face Accelerate is a lightweight library that simplifies running and scaling PyTorch and Transformers models across CPUs, GPUs, and distributed hardware with minimal code changes.

All labels observed (1)

Label Occurrences
Hugging Face Accelerate canonical 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf Python library
open-source project
software library
developer Hugging Face
documentation https://huggingface.co/docs/accelerate
goal minimize code changes for scaling models
provide hardware-agnostic training code
simplify distributed training
integratesWith Comet ML
DeepSpeed
Hugging Face Datasets
Hugging Face Transformers
PyTorch Lightning (via adapters)
TensorBoard
Weights & Biases
license Apache License 2.0
programmingLanguage Python
provides Accelerator API
command-line interface
configuration utilities
repository https://github.com/huggingface/accelerate
supportsBackend DeepSpeed
Fully Sharded Data Parallel
Megatron-LM
PyTorch Distributed Data Parallel
XLA
supportsFeature BF16 training
CPU offload
FP16 training
automatic batch splitting
automatic device placement
checkpointing
distributed evaluation
experiment tracking integration
gradient accumulation
gradient clipping
logging integration
mixed precision training
multi-GPU training
multi-node training
zero redundancy optimization via DeepSpeed
supportsFramework PyTorch
Transformers
supportsHardware CPU
GPU
TPU
distributed hardware
multi-GPU
useCase distributed inference
fine-tuning Transformer models
training large language models

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers compatibleWith Hugging Face Accelerate