Quiz Space

Large Language Models · Quiz 2 · 12 Apr 2026 · January 2026 term

Question 19: When using the SentencePiece, how are subword units sele…

Question 19

+3 marksOne correct option

When using the SentencePiece, how are subword units selected?

  1. A

    Based on a probabilistic model that maximizes the likelihood of the training data.

  2. B

    By randomly selecting character n-grams until the vocabulary limit is reached.

  3. C

    By selecting only the top 50,000 most frequent words in the corpus.

  4. D

    By iteratively merging the most frequent pair of adjacent characters.

Show answer

Correct answer

  • A

    Based on a probabilistic model that maximizes the likelihood of the training data.

See the whole paperTake it as a mock test

Question 19 of 21 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 12 Apr 2026, in the January 2026 term (Large Language Models 07 Apr 26). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3Why is the standard GPT architecture (Decoder-only with causal masking) generally unsuitable for the Masked Language Mo…
  4. Q4In the T5 (Text-to-Text Transfer Transformer) framework, every NLP task is cast as a text generation problem. If you us…
  5. Q5Figure question
  6. Q6When constructing training datasets for large language models (LLMs), which of the following best describes the key fac…
  7. Q7Which of the following are components found within a standard Transformer Encoder layer?
  8. Q8Select all correct statements regarding the comparison between RNNs and Transformers.
  9. Q9Select all correct findings from the T5 paper regarding Unsupervised Pre-training Objectives.
  10. Q10Consider the concept of Zero-Shot Transfer as popularized by GPT-2. Why might this be preferred over Supervised Fine-Tu…
  11. Q11Figure question
  12. Q12Is the given attention matrix valid for a causal language modelling task?
  13. Q13At time step t = 5 (word: data), what is the attention weight assigned to the word science? (Provide exact answer)
  14. Q14Which of the following character pairs occurs with the highest frequency across the entire sentence before any BPE merg…
  15. Q15Calculate the total vocabulary size immediately after the first merge operation is completed.\ Note: The vocabulary siz…
  16. Q16Figure question
  17. Q17Figure question
  18. Q18What is a major disadvantage of character-level tokenization?
  19. Q20To obtain high-quality training text from raw web data for large language models, which of the following mechanisms are…
  20. Q21Which of the following statements correctly explain the importance of deduplication during preprocessing of large-scale…