Wav2Vec2

E435883

Wav2Vec2 is a self-supervised deep learning model for automatic speech recognition that learns powerful audio representations directly from raw waveforms.

All labels observed (7)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf automatic speech recognition model
deep learning model
self-supervised learning model
speech representation learning model
achievesStateOfTheArtOn LibriSpeech 100h setting (at time of publication)
availableVia Hugging Face Transformers
basedOn convolutional neural networks
transformer architecture
developedBy Facebook AI Research
Meta AI
domain audio representation learning
speech processing
fineTuningDataType labeled speech with transcripts
hasComponent convolutional feature encoder
quantization module
transformer context network
hasVariant XLSR-53
linked to: Wav2Vec2

wav2vec 2.0 Base
linked to: Wav2Vec2

wav2vec 2.0 Large
linked to: Wav2Vec2

wav2vec 2.0 XLSR
linked to: Wav2Vec2
implementedIn Fairseq
PyTorch
inputType 16 kHz mono audio
inspired HuBERT
WavLM
introducedIn 2020
introducedInPaper wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
linked to: Wav2Vec2
languageCoverage English
multilingual (via XLSR variants)
learningParadigm contrastive learning
self-supervised learning
operatesOn raw audio waveforms
outperforms previous self-supervised speech models on LibriSpeech
paperAuthors Abdelrahman Mohamed
Alexei Baevski
Henry Zhou
Michael Auli
pretrainingDataType unlabeled speech audio
publishedAtConference NeurIPS 2020
linked to: NeurIPS
releasedAs open-source model
supportsTask keyword spotting
speech classification
speech recognition fine-tuning
task automatic speech recognition
trainingStrategy pretrain-then-finetune
usesMasking time-step masking on latent speech representations
usesObjective contrastive loss
masked prediction

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

Wav2Vec2 introducedInPaper wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
linked to: Wav2Vec2
Wav2Vec2 hasVariant wav2vec 2.0 Base
linked to: Wav2Vec2
Wav2Vec2 hasVariant wav2vec 2.0 Large
linked to: Wav2Vec2
Wav2Vec2 hasVariant wav2vec 2.0 XLSR
linked to: Wav2Vec2
Wav2Vec2 hasVariant XLSR-53
linked to: Wav2Vec2
HuBERT relatedTo wav2vec 2.0
linked to: Wav2Vec2