GPT-Neo

E435863

GPT-Neo is an open-source family of autoregressive language models developed by EleutherAI as a free alternative to OpenAI’s GPT-3.

All labels observed (5)

Label Occurrences
EleutherAI/gpt-neo 1
GPT-Neo canonical 1
GPT-Neo 1.3B 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf autoregressive language model family
language model
language model
language model
open-source language model
accessModel downloadable checkpoints
self-hosted
architectureType decoder-only transformer
basedOn transformer architecture
compatibleWith Hugging Face Transformers
designedAs free alternative to GPT-3
developer EleutherAI
framework PyTorch
TensorFlow
hasCommunity EleutherAI community
hasModel GPT-Neo 1.3B
linked to: GPT-Neo

GPT-Neo 125M
linked to: GPT-Neo

GPT-Neo 2.7B
linked to: GPT-Neo
hostedOn GitHub
inspiredBy GPT-3
language English
license MIT License
openSource true
parameterCount 1.3 billion
125 million
2.7 billion
programmingLanguage Python
relatedTo GPT-J
GPT-NeoX-20B
releasedBy EleutherAI
releaseYear 2021
repositoryName EleutherAI/gpt-neo
linked to: GPT-Neo
supportsInference CPU
GPU
supportsTask conditional text generation
few-shot learning
language modeling
text completion
text continuation
text generation
zero-shot learning
tokenizerType byte pair encoding
trainingData The Pile
trainingDataDeveloper EleutherAI
trainingObjective next token prediction
trainingType unsupervised learning
useCase application integration
prototyping
research

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

GPT-Neo repositoryName EleutherAI/gpt-neo
linked to: GPT-Neo
GPT-Neo hasModel GPT-Neo 125M
linked to: GPT-Neo
GPT-Neo hasModel GPT-Neo 1.3B
linked to: GPT-Neo
GPT-Neo hasModel GPT-Neo 2.7B
linked to: GPT-Neo