Statements (21)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:algorithm
|
| gptkbp:communicationPattern |
gptkb:King
|
| gptkbp:contrastsWith |
tree-based allreduce
|
| gptkbp:feature |
scalable
peer-to-peer communication bandwidth optimal |
| https://www.w3.org/2000/01/rdf-schema#label |
Ring-Allreduce algorithm
|
| gptkbp:implementedIn |
gptkb:Horovod
gptkb:NCCL gptkb:OpenMPI |
| gptkbp:proposedBy |
gptkb:Baidu_Research
|
| gptkbp:reduces |
network congestion
|
| gptkbp:step |
all-gather
scatter-reduce |
| gptkbp:usedFor |
collective communication
gradient aggregation |
| gptkbp:usedIn |
deep learning
distributed computing |
| gptkbp:yearProposed |
2017
|
| gptkbp:bfsParent |
gptkb:Horovod
|
| gptkbp:bfsLayer |
7
|