Question 4
In the encoder of a transformer model, what are the sources of the queries (Q), keys (K), and values (V)?
Q comes from the encoder output, K from the decoder input, and V from the output layer.
Q comes from the decoder output, while K and V come from the encoder input.
Q comes from the positional encoding, K from the input sequence length, and V from the output embeddings.
Q, K, and V all come from the input embeddings representing the tokens in the input sequence.