Quiz Space

Large Language Models · Quiz 1 · 19 Jul 2026 · May 2026 term

Question 12: Which of the following are components found within a GPT…

Question 12

+3 marksOne or more correct options

Which of the following are components found within a GPT decoder layer?

Select all that apply.

  1. A

    Causal (Masked) Multi-Head Self-Attention

  2. B

    Position-wise Feed-Forward Network

  3. C

    Multi Head (Cross) Attention

  4. D

    Recurrent Neural Network (RNN) Layer

  5. E

    Add & Norm Layer

Show answer

Correct answers

  • A

    Causal (Masked) Multi-Head Self-Attention

  • B

    Position-wise Feed-Forward Network

  • E

    Add & Norm Layer

See the whole paperTake it as a mock test

Question 12 of 16 in the IIT Madras BS Large Language Models (LLM) Quiz 1 paper sat on 19 Jul 2026, in the May 2026 term (Large Language Models 16 Jul 26). It carries 3 marks.

More questions from this paper

  1. Q1Which statements are true about traditional attention used in sequence-to-sequence models?
  2. Q2The query, key, and value projection matrices are given by: Based on the above data, answer the given subquestions.
  3. Q3The query, key, and value projection matrices are given by: Based on the above data, answer the given subquestions. Cho…
  4. Q4A Transformer model processes a sequence containing 6 tokens using Multi-Head Attention. The model initially uses 4 att…
  5. Q5Figure question
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Consider the following statements regarding the use of Teacher Forcing while training autoregressive sequence-to-sequen…
  9. Q9Based on the above data, answer the given subquestions.
  10. Q10Choose the option corresponding to the sentence with the highest joint probability under the given language model.
  11. Q11Using the given probability tree calculate the conditional probability of predicting "apples" given "like" [i.e P(apple…
  12. Q13The table below represents the conditional probability distribution over the vocabulary. Each column corresponds to a d…
  13. Q14The table below represents the conditional probability distribution over the vocabulary. Each column corresponds to a d…
  14. Q15The table below represents the conditional probability distribution over the vocabulary. Each column corresponds to a d…
  15. Q16The table below represents the conditional probability distribution over the vocabulary. Each column corresponds to a d…