Statements (21)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
distributed training strategy
|
| gptkbp:basedOn |
gptkb:Horovod
|
| gptkbp:category |
machine learning infrastructure
|
| gptkbp:developedBy |
gptkb:Uber
|
| gptkbp:enables |
multi-GPU training
multi-node training synchronous training scalable deep learning |
| https://www.w3.org/2000/01/rdf-schema#label |
HorovodStrategy
|
| gptkbp:integratesWith |
Keras API
PyTorch DDP tf.distribute API |
| gptkbp:requires |
gptkb:MPI
gptkb:Gloo gptkb:NCCL |
| gptkbp:supports |
data parallelism
|
| gptkbp:usedIn |
gptkb:TensorFlow
gptkb:Keras gptkb:PyTorch |
| gptkbp:bfsParent |
gptkb:PyTorch_Lightning_Strategies
|
| gptkbp:bfsLayer |
6
|