Quiz Space

Large Language Models · End Term · 10 May 2026 · January 2026 term

LLM End Term 10 May 2026 — Question 11

Question 11

+3 marksNumerical answer
Show answer

Correct answer: 640000

See the whole paperTake it as a mock test

Question 11 of 20 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 10 May 2026, in the January 2026 term (Large Language Models 10 May 26). It carries 3 marks.

More questions from this paper

  1. Q1In the standard Transformer Decoder, the Multi-Head Attention layer is "Masked". What is the specific purpose of this m…
  2. Q2Figure question
  3. Q3Figure question
  4. Q4A transformer layer with absolute positional encoding and another with ALiBi are compared on sequences extended from le…
  5. Q5Based on the BERT pre-training phase, select all correct constraints and properties regarding the input data.
  6. Q6Select the statements that correctly distinguish fine-tuning from zero-shot prompting for GPT-style models.
  7. Q7Figure question
  8. Q8Figure question
  9. Q9Figure question
  10. Q10Suppose a language model outputs the following logits for a vocabulary of size 4:
  11. Q12Adapter Layers are a parameter-efficient fine-tuning strategy. Where are these layers typically inserted within a Trans…
  12. Q13Why do standard LLM architectures include explicit Positional Encodings (like RoPE or Sinusoidal) despite the causal ma…
  13. Q14Figure question
  14. Q15Consider Multi-Query Attention (MQA). How does its architecture differ from standard Multi-Head Attention (MHA) to impr…
  15. Q16Figure question
  16. Q17Figure question
  17. Q18Which of the following statements about fine-tuning strategies such as gradual unfreezing and multi-task learning in th…
  18. Q19Select all correct statements regarding Local Attention Variants (like Sparse, Dilated, or Windowed Attention).
  19. Q20Which of the following techniques are used in Flash Attention to speed up attention computation and save memory?