Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:academic_journal
|
| gptkbp:author |
gptkb:Slav_Petrov
gptkb:Yanping_Huang gptkb:Noam_Shazeer gptkb:Zhifeng_Chen Dehao Chen Dmitry Lepikhin HyoukJoong Lee Maxim Krikun Orhan Firat Yuanzhong Xu |
| https://www.w3.org/2000/01/rdf-schema#label |
Lepikhin et al., 2021
|
| gptkbp:publishedIn |
Proceedings of the 37th International Conference on Machine Learning (ICML 2021)
|
| gptkbp:publisher |
gptkb:PMLR
|
| gptkbp:title |
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
|
| gptkbp:topic |
gptkb:GShard
automatic sharding conditional computation large-scale neural networks |
| gptkbp:url |
https://proceedings.mlr.press/v119/lepikhin20a.html
|
| gptkbp:year |
2021
|
| gptkbp:bfsParent |
gptkb:MoE_Transformer
|
| gptkbp:bfsLayer |
6
|