Statements (35)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:architecture |
gptkb:Mixture_of_Experts
|
| gptkbp:bench |
gptkb:GSM8K
gptkb:HumanEval gptkb:MMLU |
| gptkbp:context |
32K tokens
|
| gptkbp:developedBy |
gptkb:Mistral_AI
|
| gptkbp:github |
https://github.com/mistralai/mixtral-8x7b
|
| gptkbp:hasModel |
gptkb:transformation
|
| https://www.w3.org/2000/01/rdf-schema#label |
Mixtral
|
| gptkbp:improves |
gptkb:Llama_2_70B
|
| gptkbp:language |
gptkb:French
English |
| gptkbp:license |
Apache 2.0
|
| gptkbp:notableFeature |
Sparse MoE routing
|
| gptkbp:notableFor |
research
content creation chatbots assistants |
| gptkbp:notableRelease |
gptkb:Mixtral_8x7B
|
| gptkbp:openSource |
true
|
| gptkbp:parameter |
46B
|
| gptkbp:releaseDate |
2023
|
| gptkbp:supports |
translator
code generation summarization text generation reasoning tasks |
| gptkbp:tokenizer |
gptkb:SentencePiece
|
| gptkbp:trainer |
gptkb:law
gptkb:Wikipedia books web text |
| gptkbp:bfsParent |
gptkb:transformation
|
| gptkbp:bfsLayer |
5
|