LLM Quiz 1 26 Oct 2025 — Question 6
Show answer
Correct answer
Question 6 of 20 in the IIT Madras BS Large Language Models (LLM) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 2 marks.
More questions from this paper
- Figure question
- Which of the following is true regarding sinusoidal encoding?
- We have a transformer model translating English to French. Suppose the target sequence is: Target (French): [‘je’, ‘sui…
- Figure question
- In the context of language model training, teacher forcing is a technique where:
- You have a mini-batch of 2 samples, each with 2 features: X = \begin{bmatrix} 1 & 2 \ 3 & 4 \end{bmatrix} Rows represen…
- Figure question
- For a vocabulary size of 10, how many beams will there be in greedy search, beam search with beam size 3, and exhaustiv…
- Which of the following decoding strategies is/are inherently non-deterministic?
- Which of the following statements about multiple attention heads in a Transformer are true?
- Which of the following statements about the Transformer architecture are true?
- A transformer decoder uses a vocabulary of size 5. At step 1, the predicted token probabilities are: | Token | Probabil…
- Figure question
- A Transformer model processes a sequence of T = 1000 tokens. Within the self-attention layer, the attention scores are …
- Figure question
- How many next-token prediction targets are generated during training a full batch?
- For one sequence, how many non-zero attention scores remain in the masked attention score matrix (per head)?
- You are analyzing a GPT-style decoder-only Transformer trained as a causal language model with the following setup: Seq…
- During autoregressive inference with GPT: