DBRX: A Large, Open, Mixture-of-Experts Language Model
GPTKB entity
Statements (27)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
mixture-of-experts model |
| gptkbp:architecture |
Mixture-of-Experts
|
| gptkbp:availableOn |
gptkb:Hugging_Face
gptkb:Databricks_platform |
| gptkbp:competitor |
gptkb:GPT-3.5
gptkb:Llama_2 gptkb:Mixtral |
| gptkbp:context |
32K tokens
|
| gptkbp:developedBy |
gptkb:Databricks
|
| https://www.w3.org/2000/01/rdf-schema#label |
DBRX: A Large, Open, Mixture-of-Experts Language Model
|
| gptkbp:language |
English
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:notablePublication |
gptkb:DBRX:_A_Large,_Open,_Mixture-of-Experts_Language_Model
https://arxiv.org/abs/2403.05530 |
| gptkbp:openSource |
true
|
| gptkbp:parameter |
132B
|
| gptkbp:releaseYear |
2024
|
| gptkbp:supports |
chat
reasoning code generation question answering summarization |
| gptkbp:trainer |
public datasets
custom Databricks data |
| gptkbp:bfsParent |
gptkb:DBRX
|
| gptkbp:bfsLayer |
7
|