VQ-VAE

E755720

VQ-VAE is a neural network model that combines vector quantization with variational autoencoders to learn discrete latent representations for tasks like image and audio generation.

All labels observed (4)

Label Occurrences
VQ-VAE-2 3
VQ-VAE canonical 2
Vector Quantized Variational Autoencoder 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf neural network model
addressesProblem learning discrete representations
posterior collapse in VAEs
basedOn variational autoencoder
canBeExtendedTo VQ-VAE-2
linked to: VQ-VAE

hierarchical VQ-VAE
linked to: VQ-VAE
codebookSize hyperparameter
embeddingDimension hyperparameter
fullName Vector Quantized Variational Autoencoder
linked to: VQ-VAE
hasAdvantage avoids sampling from continuous latent distributions at training time
enables use of powerful autoregressive priors over codes
produces interpretable discrete codes
hasComponent codebook
codebook loss term
commitment loss term
decoder
embedding vectors
encoder
reconstruction loss term
hasLatentSpaceType discrete latent space
inputType audio waveforms
images
spectrograms
inspired subsequent discrete representation models
introducedInPaper Neural Discrete Representation Learning
latentRepresentation indices into a codebook of embeddings
outputType reconstructed audio
reconstructed images
primaryApplication audio generation
compression
image generation
representation learning
speech generation
proposedBy Aaron van den Oord
Koray Kavukcuoglu
Oriol Vinyals
publicationYear 2017
publishedByOrganization DeepMind
usedWith PixelCNN prior
linked to: PixelCNN

WaveNet prior
linked to: WaveNet
usesOptimizationMethod Adam optimizer
stochastic gradient descent
usesTechnique vector quantization
usesTrainingObjective codebook vector quantization
commitment loss regularization
reconstruction error minimization
usesTrick straight-through estimator

How these facts were elicited

Referenced by (8)

Full triples — surface form annotated when it differs from this entity's canonical label.

Aaron van den Oord developed VQ-VAE-2
linked to: VQ-VAE
VQ-VAE fullName Vector Quantized Variational Autoencoder
linked to: VQ-VAE
VQ-VAE canBeExtendedTo VQ-VAE-2
linked to: VQ-VAE
VQ-VAE canBeExtendedTo hierarchical VQ-VAE
linked to: VQ-VAE
Neural Discrete Representation Learning introduces Vector Quantized Variational Autoencoder
linked to: VQ-VAE
Neural Discrete Representation Learning influenced VQ-VAE-2
linked to: VQ-VAE