Quiz Space

Large Language Models · End Term · 21 Dec 2025 · September 2025 term · Set 1-2

Question 12: A model with positional encoding crashes when the input …

Question 12

+2 marksOne correct option

A model with positional encoding crashes when the input length exceeds the training max length. Which encoding is it most likely using?

  1. A

    ALiBi

  2. B

    APE

  3. C

    RoPE

  4. D

    RPE

Show answer

Correct answer

  • B

    APE

See the whole paperTake it as a mock test

Question 12 of 25 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 21 Dec 2025, in the September 2025 term (Large Language Models 21 Dec 25). It carries 2 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3Figure question
  4. Q4For a 4-category classification task, how would you use BERT's output?
  5. Q5A hospital wants to extract disease mentions and treatment plans from unstructured clinical notes. Notes use heavy abbr…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Figure question
  9. Q9If a model uses RoPE, increasing the sequence length from 100 to 1000 requires:
  10. Q10Figure question
  11. Q11Figure question
  12. Q13Figure question
  13. Q14Which of the following decoding method(s) can generate a different output every time you run the model with the same pr…
  14. Q15Figure question
  15. Q16Figure question
  16. Q17Figure question
  17. Q18Which of the following statements accurately describes the properties and computational complexities of the various spa…
  18. Q19Figure question
  19. Q20Suppose you are working on prefix language modeling. The sequence length is 10 and the first two tokens represent the t…
  20. Q21Figure question
  21. Q22Which of the following describes the fundamental training mechanism of this model?
  22. Q23During training, they strictly enforce teacher forcing, meaning the ground-truth previous tokens are always provided as…
  23. Q24In the inference phase (when the model is used for generation), why is the teacher forcing technique not used, and what…
  24. Q25Which component of the Transformer decoder is essential for enforcing the Causal Language Modeling constraint?