Quiz Space

Large Language Models · Quiz 2 · 16 Aug 2026 · May 2026 term

Question 17: Consider the following corpus consisting of 4 words (ign…

Question 17

+3 marksOne or more correct options

Consider the following corpus consisting of 4 words (ignore spaces and punctuation). there is no spoon The vocabulary is constructed using the whole words in this corpus and the individual characters in this corpus. The vocabulary should now have 13 tokens. Use this vocabulary for the given subquestions.

Using the vocabulary constructed, two new continuous strings: "prison" and "rhino" are to be segmented. Which of the following proposed segmentations are valid?

Select all that apply.

  1. A

    prison

  2. B

    p, r, is, o, n

  3. C

    p, r, is, on

  4. D

    r, h, i, n, o

  5. E

    r, h, i, no

Show answer

Correct answers

  • B

    p, r, is, o, n

  • D

    r, h, i, n, o

  • E

    r, h, i, no

See the whole paperTake it as a mock test

Question 17 of 18 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 16 Aug 2026, in the May 2026 term (Large Language Models 16 Aug 26). It carries 3 marks.

More questions from this paper

  1. Q1Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block In the given Trans…
  2. Q2Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block Identify the funct…
  3. Q3Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block Based on the archi…
  4. Q4Figure question
  5. Q5Which of the following options correctly reflect the internal state updates performed during a Byte Pair Encoding (BPE)…
  6. Q6A baseline T5 model with denoising objective on a span of corrupted tokens is used for unsupervised pre-training. Consi…
  7. Q7During the fine-tuning of GPT-1 for Textual Entailment tasks, what is the purpose of the delimiter token (\$)?
  8. Q8During the fine-tuning of a decoder-only Transformer for sequence classification, why is the hidden representation of t…
  9. Q9Figure question
  10. Q10In the WordPiece tokenization algorithm, how does the scoring formula prioritize token merges?
  11. Q11Consider the T5 "text-to-text" paradigm. How does the model process fundamentally different tasks such as Semantic Simi…
  12. Q12In the context of the BART (Bidirectional AutoRegressive Transformer) architecture, how does the model handle corrupted…
  13. Q13When comparing the C4 dataset to an 'Unfiltered-C4' dataset that is 8 times larger, what was the observed effect on dow…
  14. Q14Which of the following describes the 'Adapter Layers' fine-tuning strategy?
  15. Q15Which of the following is a reported negative effect of including significantly duplicated content in LLM training data?
  16. Q16Figure question
  17. Q18Consider the following corpus consisting of 4 words (ignore spaces and punctuation). there is no spoon The vocabulary i…