Quiz Space

Large Language Models · End Term · 21 Dec 2025 · September 2025 term · Set 1-2

Question 24: In the inference phase (when the model is used for gener…

Question 24

+1 markOne correct option

During training, they strictly enforce teacher forcing, meaning the ground-truth previous tokens are always provided as input to predict the current token. Based on the above setup, answer the given subquestions.

In the inference phase (when the model is used for generation), why is the teacher forcing technique not used, and what is the primary challenge this introduces?

  1. A

    Teacher forcing is used, but only with a small probability.

  2. B

    It's not used because the ground-truth sequence is unknown; this introduces the exposure bias problem, where the model is unfamiliar with its own prediction errors.

  3. C

    It's not used because it drastically slows down the inference speed.

  4. D

    It's not used; the challenge is the need for a separate encoder-decoder architecture.

Show answer

Correct answer

  • B

    It's not used because the ground-truth sequence is unknown; this introduces the exposure bias problem, where the model is unfamiliar with its own prediction errors.

See the whole paperTake it as a mock test

Question 24 of 25 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 21 Dec 2025, in the September 2025 term (Large Language Models 21 Dec 25). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3Figure question
  4. Q4For a 4-category classification task, how would you use BERT's output?
  5. Q5A hospital wants to extract disease mentions and treatment plans from unstructured clinical notes. Notes use heavy abbr…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Figure question
  9. Q9If a model uses RoPE, increasing the sequence length from 100 to 1000 requires:
  10. Q10Figure question
  11. Q11Figure question
  12. Q12A model with positional encoding crashes when the input length exceeds the training max length. Which encoding is it mo…
  13. Q13Figure question
  14. Q14Which of the following decoding method(s) can generate a different output every time you run the model with the same pr…
  15. Q15Figure question
  16. Q16Figure question
  17. Q17Figure question
  18. Q18Which of the following statements accurately describes the properties and computational complexities of the various spa…
  19. Q19Figure question
  20. Q20Suppose you are working on prefix language modeling. The sequence length is 10 and the first two tokens represent the t…
  21. Q21Figure question
  22. Q22Which of the following describes the fundamental training mechanism of this model?
  23. Q23During training, they strictly enforce teacher forcing, meaning the ground-truth previous tokens are always provided as…
  24. Q25Which component of the Transformer decoder is essential for enforcing the Causal Language Modeling constraint?