Statements (28)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
distributed computing framework
|
| gptkbp:documentation |
https://pytorch.org/docs/stable/distributed.html
|
| https://www.w3.org/2000/01/rdf-schema#label |
PyTorch Distributed
|
| gptkbp:language |
gptkb:Python
gptkb:C++ |
| gptkbp:openSource |
true
|
| gptkbp:partOf |
gptkb:PyTorch
|
| gptkbp:provides |
gptkb:torch.distributed_package
|
| gptkbp:supports |
gptkb:Gloo_backend
gptkb:NCCL_backend distributed training data parallelism model parallelism multi-GPU training RPC framework point-to-point communication collective communication MPI backend multi-node training |
| gptkbp:usedBy |
gptkb:researchers
industry practitioners |
| gptkbp:usedFor |
distributed data loading
large-scale training parameter server architectures scaling deep learning models synchronizing gradients |
| gptkbp:bfsParent |
gptkb:Meta_AI
|
| gptkbp:bfsLayer |
5
|