Quiz Space

Large Language Models · End Term · 13 Sept 2026 · May 2026 term · Set 1

Question 6: Consider a tokenizer processing the word "lion".\ The voc…

Question 6

+3 marksWritten answer

Consider a tokenizer processing the word "lion".
The vocabulary contains the following tokens along with the assigned log-probabilities.

To determine the optimal tokenization, the tokenizer uses the forward decoding algorithm (Viterbi approach). Determine the most likely tokenization for the word "lion" using the algorithm. Instructions: Enter your answer as a lowercase string with the segments separated by a comma. For example, if the word is whereby and the answer has two segments where and by, enter the answer as where,by
NOTE: Enter the exact answer without any extra space in the beginning or at the end. Answers Case Sensitive : No

Show answer

Correct answer: l,i,on

See the whole paperTake it as a mock test

Question 6 of 18 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 13 Sept 2026, in the May 2026 term (Large Language Models 13 Sep 26 (Session 2)). It carries 3 marks.

More questions from this paper

  1. Q1Consider the following Assertion (A) and Reason (R) about the Transformer encoder. Assertion (A): In a Transformer enco…
  2. Q2Which of the following statements regarding one-hot positional encoding and sinusoidal positional encoding is incorrect?
  3. Q3You are designing an LLM to translate a sentence from English to Spanish with low computational complexity. The system …
  4. Q4In the Next Sentence Prediction task, how are the two input sentences distinguished by the BERT architecture?
  5. Q5Consider a mini-batch of 3 samples, each with 2 features. The input matrix X is given below, where rows represent indiv…
  6. Q7Figure question
  7. Q8Consider an LLM operating on a vocabulary consisting of 5 tokens. For a given context, the model produces the following…
  8. Q9Consider an LLM operating on a vocabulary consisting of 5 tokens. For a given context, the model produces the following…
  9. Q10How did the GPT-2 model initially demonstrate "zero-shot domain transfer" capabilities on complex tasks like summarizat…
  10. Q11Match the following unsupervised objectives (I,II,III) to their corresponding Target output structures (A,B,C) based on…
  11. Q12Consider the original text "The quick brown fox jumps over the lazy dog". If the input for a prefix language modelling …
  12. Q13Consider a transformer model that uses strided local attention with a fixed window size c. If the sequence length T is …
  13. Q14What is the primary trade-off made by utilizing KV Cache during autoregressive decoding?
  14. Q15A Large Language model uses Grouped Query Attention with a KV cache during inference. Consider the following model conf…
  15. Q16Which of the following statements about length generalization in Large Language Models (LLMs) are correct?
  16. Q17The query and key projection matrices are and RoPE Frequency For RoPE, use the frequency formula Using the property the…
  17. Q18The query and key projection matrices are and RoPE Frequency For RoPE, use the frequency formula Using the property the…