RWKV

GPTKB entity

Statements (28)
Predicate Object
gptkbp:instanceOf gptkb:model
large language model
gptkbp:architecture RNN-Transformer hybrid
gptkbp:containsCommunity gptkb:Discord
gptkb:GitHub
gptkbp:developer gptkb:BlinkDL
gptkbp:hasModel gptkb:RWKV-4
gptkb:RWKV-5
gptkb:RWKV-World
https://www.w3.org/2000/01/rdf-schema#label RWKV
gptkbp:language gptkb:Python
gptkb:CUDA
gptkbp:license Apache 2.0
gptkbp:notableFeature combines RNN and Transformer advantages
efficient for long sequences
scales linearly with sequence length
gptkbp:openSource true
gptkbp:purpose natural language processing
gptkbp:releaseYear 2022
gptkbp:supports chatbot
text generation
text completion
gptkbp:usedFor research
open-source projects
gptkbp:website https://github.com/BlinkDL/RWKV
gptkbp:bfsParent gptkb:transformation
gptkb:GPT-3
gptkbp:bfsLayer 5