Quiz Space

Large Language Models · End Term · 21 Dec 2025 · September 2025 term · Set 1-2

Question 22: Which of the following describes the fundamental trainin…

Question 22

+1 markOne correct option

During training, they strictly enforce teacher forcing, meaning the ground-truth previous tokens are always provided as input to predict the current token. Based on the above setup, answer the given subquestions.

Which of the following describes the fundamental training mechanism of this model?

  1. A
  2. B
  3. C
Show answer

Correct answer

  • B
See the whole paperTake it as a mock test

Question 22 of 25 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 21 Dec 2025, in the September 2025 term (Large Language Models 21 Dec 25). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3Figure question
  4. Q4For a 4-category classification task, how would you use BERT's output?
  5. Q5A hospital wants to extract disease mentions and treatment plans from unstructured clinical notes. Notes use heavy abbr…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Figure question
  9. Q9If a model uses RoPE, increasing the sequence length from 100 to 1000 requires:
  10. Q10Figure question
  11. Q11Figure question
  12. Q12A model with positional encoding crashes when the input length exceeds the training max length. Which encoding is it mo…
  13. Q13Figure question
  14. Q14Which of the following decoding method(s) can generate a different output every time you run the model with the same pr…
  15. Q15Figure question
  16. Q16Figure question
  17. Q17Figure question
  18. Q18Which of the following statements accurately describes the properties and computational complexities of the various spa…
  19. Q19Figure question
  20. Q20Suppose you are working on prefix language modeling. The sequence length is 10 and the first two tokens represent the t…
  21. Q21Figure question
  22. Q23During training, they strictly enforce teacher forcing, meaning the ground-truth previous tokens are always provided as…
  23. Q24In the inference phase (when the model is used for generation), why is the teacher forcing technique not used, and what…
  24. Q25Which component of the Transformer decoder is essential for enforcing the Causal Language Modeling constraint?