Hugging Face Accelerate

E435889

Hugging Face Accelerate is a lightweight library that simplifies running and scaling PyTorch and Transformers models across CPUs, GPUs, and distributed hardware with minimal code changes.

All labels observed (1)

Label Occurrences
Hugging Face Accelerate canonical 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf Python library
open-source project
software library
developer Hugging Face NERFINISHED
documentation https://huggingface.co/docs/accelerate
goal minimize code changes for scaling models
provide hardware-agnostic training code
simplify distributed training
integratesWith Comet ML NERFINISHED
DeepSpeed NERFINISHED
Hugging Face Datasets NERFINISHED
Hugging Face Transformers NERFINISHED
PyTorch Lightning (via adapters) NERFINISHED
TensorBoard NERFINISHED
Weights & Biases NERFINISHED
license Apache License 2.0
programmingLanguage Python
provides Accelerator API NERFINISHED
command-line interface
configuration utilities
repository https://github.com/huggingface/accelerate
supportsBackend DeepSpeed NERFINISHED
Fully Sharded Data Parallel
Megatron-LM NERFINISHED
PyTorch Distributed Data Parallel NERFINISHED
XLA NERFINISHED
supportsFeature BF16 training
CPU offload
FP16 training
automatic batch splitting
automatic device placement
checkpointing
distributed evaluation
experiment tracking integration
gradient accumulation
gradient clipping
logging integration
mixed precision training
multi-GPU training
multi-node training
zero redundancy optimization via DeepSpeed
supportsFramework PyTorch NERFINISHED
Transformers NERFINISHED
supportsHardware CPU
GPU
TPU NERFINISHED
distributed hardware
multi-GPU
useCase distributed inference
fine-tuning Transformer models
training large language models

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers compatibleWith Hugging Face Accelerate