Quiz Space

Deep Learning · End Term · 21 Dec 2025 · September 2025 term

Question 3: Which of the following is not true about multi-head cross…

Question 3

+3 marksOne correct option

Which of the following is not true about multi-head cross attention?

  1. A

    Keys and values are taken from the encoder outputs

  2. B

    Queries come from the decoder outputs

  3. C

    All heads attend to identical features due to shared projection matrices

  4. D

    Each head learns to attend to different representation subspaces

Show answer

Correct answer

  • C

    All heads attend to identical features due to shared projection matrices

See the whole paperTake it as a mock test

Question 3 of 32 in the IIT Madras BS Deep Learning (Deep Learning) End Term paper sat on 21 Dec 2025, in the September 2025 term (Deep Learning 18 Dec 25). It carries 3 marks.

More questions from this paper

  1. Q1What is a co-occurrence matrix in the context of Natural Language Processing?
  2. Q2What is the primary advantage of word embeddings compared to one-hot encoding?
  3. Q4What is the primary advantage of Transformer encoders over RNN encoders for long sequences?
  4. Q5Figure question
  5. Q6Figure question
  6. Q7Figure question
  7. Q8Which of the following optimizers use momentum (or momentum-like mechanisms) in updating gradients?
  8. Q9Regarding the specific gating mechanisms used to control information flow and gradients in LSTMs and GRUs, which statem…
  9. Q10Which of the following statements are true for the saturated neurons problem? Select all that apply.
  10. Q11Figure question
  11. Q12You are training a deep feedforward neural network (100 layers) for binary classification with a sigmoid output with ta…
  12. Q13Why is the sigmoid activation function often preferred over the step activation function in neural networks?
  13. Q14Figure question
  14. Q15Consider the sigmoid activation function defined as:
  15. Q16Figure question
  16. Q17Figure question
  17. Q18Figure question
  18. Q19Based on the above data, answer the given subquestions.
  19. Q20Figure question
  20. Q21Identify the word in the vocabulary with the highest predicted probability for the missing word (???), and provide its …
  21. Q22Based on the above data, answer the given subquestions.
  22. Q23Figure question
  23. Q24Based on the above data, answer the given subquestions.
  24. Q25Identify the word in the vocabulary that has the highest probability of being predicted as a context word given the cen…
  25. Q26Based on the above data, answer the given subquestions.
  26. Q27How many total weights from Win and Wout combined will be updated?
  27. Q28Based on the above data, answer the given subquestions.
  28. Q29The previous decoder hidden state is: and Based on the above data, answer the given subquestions.
  29. Q30Based on the above data, answer the given subquestions.
  30. Q31The previous decoder hidden state is: and Based on the above data, answer the given subquestions.
  31. Q32The previous decoder hidden state is: and Based on the above data, answer the given subquestions.