Statements (20)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:model
|
| gptkbp:availableOn |
gptkb:GitHub
|
| gptkbp:developedBy |
gptkb:Microsoft
|
| gptkbp:enables |
data parallelism
model parallelism efficient distributed training expert parallelism |
| gptkbp:firstReleased |
2021
|
| https://www.w3.org/2000/01/rdf-schema#label |
DeepSpeed-MoE
|
| gptkbp:license |
gptkb:MIT_License
|
| gptkbp:openSource |
true
|
| gptkbp:partOf |
gptkb:DeepSpeed
|
| gptkbp:programmingLanguage |
gptkb:Python
|
| gptkbp:supports |
gptkb:Mixture_of_Experts
gptkb:PyTorch |
| gptkbp:usedFor |
scaling large language models
|
| gptkbp:website |
https://www.deepspeed.ai/
|
| gptkbp:bfsParent |
gptkb:Mixture_of_Experts_(MoE)
gptkb:DeepSpeed |
| gptkbp:bfsLayer |
7
|