EncoderDecoderModel

E435886

EncoderDecoderModel is a Hugging Face Transformers architecture that combines a separate encoder and decoder into a unified sequence-to-sequence model for tasks like translation, summarization, and text generation.

All labels observed (2)

Label Occurrences
EncoderDecoderModel canonical 1
encoder-decoder Transformer 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf Hugging Face Transformers class
neural network architecture
sequence-to-sequence model
canUseDecoderType BertLMHeadModel
GPT2LMHeadModel
linked to: GPT-2

RobertaForCausalLM
linked to: RoBERTa

XLNetLMHeadModel
linked to: XLNet
canUseEncoderType BertModel
DistilBertModel
linked to: DistilBERT

LongformerModel
linked to: Longformer

RobertaModel
linked to: RoBERTa
documentationUrl https://huggingface.co/docs/transformers/model_doc/encoder_decoder
hasComponent decoder
encoder
hasMethod forward
from_encoder_decoder_pretrained
from_pretrained
generate
implementedIn Python
inheritsFrom PreTrainedModel
inputType attention_mask
decoder_attention_mask
decoder_input_ids
input_ids
isCompatibleWith AutoTokenizer
Seq2SeqTrainer
isDefinedInModule transformers.models.encoder_decoder
isUsedFor building custom seq2seq models from separate encoder and decoder checkpoints
outputType decoder_hidden_states
encoder_last_hidden_state
logits
loss
providedBy Hugging Face Transformers library
supportsFeature encoder-decoder attention
gradient checkpointing
teacher forcing
weight tying
supportsGenerationStrategy beam search
greedy search
sampling
top-k sampling
top-p sampling
supportsTask conditional text generation
machine translation
sequence-to-sequence learning
text generation
text summarization
supportsTrainingObjective cross-entropy loss
usesConfigClass EncoderDecoderConfig

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers supportsModelType EncoderDecoderModel
Transformer hasVariant encoder-decoder Transformer
linked to: EncoderDecoderModel