Statements (35)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:large_language_model
|
| gptkbp:architecture |
gptkb:RWKV
|
| gptkbp:availableOn |
gptkb:GitHub
|
| gptkbp:containsCommunity |
RWKV Discord
RWKV GitHub Discussions |
| gptkbp:developedBy |
gptkb:BlinkDL
|
| gptkbp:hasModel |
transformer-RNN hybrid
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:notableFor |
efficient inference
linear scaling long context support no attention mechanism scalable to long sequences |
| gptkbp:openSource |
true
|
| gptkbp:parameter |
7B
14B 32B 169M |
| gptkbp:platform |
gptkb:microprocessor
gptkb:graphics_card gptkb:Raspberry_Pi gptkb:Apple_Silicon |
| gptkbp:predecessor |
RWKV-3
|
| gptkbp:releaseYear |
2023
|
| gptkbp:supports |
gptkb:Chinese
English |
| gptkbp:trainer |
gptkb:Wikipedia
books web text |
| gptkbp:usedFor |
text generation
chatbots language understanding |
| gptkbp:bfsParent |
gptkb:RWKV
|
| gptkbp:bfsLayer |
7
|
| https://www.w3.org/2000/01/rdf-schema#label |
RWKV-4
|