Statements (25)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:large_language_model
|
| gptkbp:architecture |
gptkb:transformation
|
| gptkbp:attentionMechanism |
disentangled attention
|
| gptkbp:availableOn |
gptkb:Hugging_Face_Model_Hub
|
| gptkbp:basedOn |
gptkb:DeBERTa
|
| gptkbp:citation |
1000+
|
| gptkbp:developedBy |
gptkb:Microsoft
|
| gptkbp:fineTunedWith |
true
|
| gptkbp:input |
gptkb:text
|
| gptkbp:language |
English
|
| gptkbp:notablePublication |
gptkb:DeBERTa:_Decoding-enhanced_BERT_with_Disentangled_Attention
|
| gptkbp:openSource |
true
|
| gptkbp:parameter |
900M
|
| gptkbp:releaseYear |
2021
|
| gptkbp:supports |
gptkb:TensorFlow
gptkb:PyTorch |
| gptkbp:tokenizerType |
gptkb:WordPiece
|
| gptkbp:trainer |
large text corpora
|
| gptkbp:usedFor |
question answering
natural language understanding text classification named entity recognition |
| gptkbp:bfsParent |
gptkb:DeBERTa
|
| gptkbp:bfsLayer |
8
|
| https://www.w3.org/2000/01/rdf-schema#label |
DeBERTa-XLarge
|