Question 5
Vector Quantized Variational Autoencoder (VQ-VAE) utilizes a discrete latent representation as opposed to continuous latent spaces used in traditional VAEs. One of the key components of a VQ- VAE is the codebook, which consists of a set of learnable vectors. What is the primary role of the codebook in VQ-VAE?
It performs the non-linear transformation of the input data to a higher dimensional space.
It regularizes the encoder by penalizing complex encodings.
It provides a finite set of vectors which the encoder’s outputs are mapped to, effectively quantizing the latent space.
It decodes the quantized vectors back into the reconstructed input space.