Horovod

E760433

Horovod is an open-source distributed deep learning framework designed to make training models across multiple GPUs and machines fast and easy.

All labels observed (1)

Label Occurrences
Horovod canonical 1

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf distributed deep learning framework
open-source software
category deep learning software
distributed computing
machine learning infrastructure
designGoal make distributed deep learning easy to use
make distributed deep learning fast
developedBy Uber
feature fault-tolerant training with elastic mode
hierarchical allreduce
integration with Apache Spark
mixed-precision training support
ring-allreduce algorithm for gradient averaging
timeline profiling for performance debugging
initialReleaseDate 2017
keyOperation allgather
allreduce
broadcast
license Apache License 2.0
notableUser Uber
optimizedFor multi-GPU training
multi-node training
parallelismType data parallelism
primaryUse distributed training of deep learning models
programmingLanguage C++
CUDA
linked to: NVIDIA CUDA

Python
repository https://github.com/horovod/horovod
supportsFramework Apache MXNet
linked to: MXNet

Keras
PyTorch
TensorFlow
XGBoost
supportsHardware CPU
GPU
multi-GPU systems
multi-node clusters
supportsLanguage Apache MXNet
linked to: MXNet

Keras
PyTorch
Spark ML
linked to: Spark MLlib

TensorFlow
supportsPlatform cloud environments
on-premise clusters
usesCommunicationBackend Gloo
MPI
NCCL
website https://horovod.ai

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.

NCCL usedBy Horovod