Quiz Space

Large Language Models · End Term · 31 Aug 2025 · May 2025 term · Set QDB3

Question 1: Given the input string: sunshine And the following vocabu…

Question 1

+3 marksOne correct option

Given the input string:

sunshine

And the following vocabulary of subword tokens with their corresponding log-probabilities:

SubwordLog-Probability (base ee)
sun-0.5
shine-0.7
sunshine-1.6
su-0.3
nshine-0.4
n-1.8
shi-0.6
ne-0.5

Using the Viterbi algorithm (as used in the SentencePiece tokenizer), determine the most probable tokenization of the input string. The probability of a tokenized sequence is the sum of the log-probabilities of the selected subwords. Only subwords from the vocabulary may be used.

  1. A
  2. B
  3. C
  4. D
Show answer

Correct answer

  • B
See the whole paperTake it as a mock test

Question 1 of 17 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 31 Aug 2025, in the May 2025 term (IIT M DEGREE AN EXAM QDB3 31 Aug 2025). It carries 3 marks.

More questions from this paper

  1. Q2A GPT model is trained using causal language modeling. During training, for a sequence of T = 4 tokens, which of the fo…
  2. Q3Figure question
  3. Q4Which of the following preprocessing steps are commonly used when preparing data for transformer models like BERT?
  4. Q5Which modifications are used in transformers to handle longer sequences efficiently?
  5. Q6In Transformer models that use relative position embeddings (such as in Transformer-XL or T5), clipping is often applie…
  6. Q7Figure question
  7. Q8For the input “you enjoy tea often”, compute the final representation of the word “enjoy” after the attention layer (i.…
  8. Q9Suppose the input sentence is “tea you enjoy often”. Using the same matrices and processing method, what is the attenti…
  9. Q10Choose the correct representation of π for the given mask image.
  10. Q11How many permutations of π are possible for n = 5?
  11. Q12What percentage of entries in the attention matrix are zero (i.e., the sparsity)?
  12. Q13Consider the short sentence: “small models sometimes beat big ones” A model processes this sequence using the naive rel…
  13. Q14Consider the short sentence: “small models sometimes beat big ones” A model processes this sequence using the naive rel…
  14. Q15Consider the short sentence: “small models sometimes beat big ones” A model processes this sequence using the naive rel…
  15. Q16Consider the short sentence: “small models sometimes beat big ones” A model processes this sequence using the naive rel…
  16. Q17Consider the short sentence: “small models sometimes beat big ones” A model processes this sequence using the naive rel…