Quiz Space

Large Language Models · Quiz 2 · 16 Aug 2026 · May 2026 term

Question 11: Consider the T5 "text-to-text" paradigm. How does the mo…

Question 11

+3 marksOne correct option

Consider the T5 "text-to-text" paradigm. How does the model process fundamentally different tasks such as Semantic Similarity (continuous regression) and Sentiment Analysis (discrete classification) during the fine-tuning phase?

  1. A

    The model uses the encoder to output the regression score and decoder for the classification tokens switching based on the input prompt.

  2. B

    The decoder part of the model is appended with separate prediction heads for regression and classification which are updated based on Mean Squared Error and Cross-Entropy respectively.

  3. C

    The model treats both tasks as sequence generation objectives with task- specific prefix added in the input and all output is generated as strings.

  4. D

    None of these.

Show answer

Correct answer

  • C

    The model treats both tasks as sequence generation objectives with task- specific prefix added in the input and all output is generated as strings.

See the whole paperTake it as a mock test

Question 11 of 18 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 16 Aug 2026, in the May 2026 term (Large Language Models 16 Aug 26). It carries 3 marks.

More questions from this paper

  1. Q1Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block In the given Trans…
  2. Q2Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block Identify the funct…
  3. Q3Answer the subquestions for the given transformer architecture for one (N = 1) Encoder Decoder Block Based on the archi…
  4. Q4Figure question
  5. Q5Which of the following options correctly reflect the internal state updates performed during a Byte Pair Encoding (BPE)…
  6. Q6A baseline T5 model with denoising objective on a span of corrupted tokens is used for unsupervised pre-training. Consi…
  7. Q7During the fine-tuning of GPT-1 for Textual Entailment tasks, what is the purpose of the delimiter token (\$)?
  8. Q8During the fine-tuning of a decoder-only Transformer for sequence classification, why is the hidden representation of t…
  9. Q9Figure question
  10. Q10In the WordPiece tokenization algorithm, how does the scoring formula prioritize token merges?
  11. Q12In the context of the BART (Bidirectional AutoRegressive Transformer) architecture, how does the model handle corrupted…
  12. Q13When comparing the C4 dataset to an 'Unfiltered-C4' dataset that is 8 times larger, what was the observed effect on dow…
  13. Q14Which of the following describes the 'Adapter Layers' fine-tuning strategy?
  14. Q15Which of the following is a reported negative effect of including significantly duplicated content in LLM training data?
  15. Q16Figure question
  16. Q17Consider the following corpus consisting of 4 words (ignore spaces and punctuation). there is no spoon The vocabulary i…
  17. Q18Consider the following corpus consisting of 4 words (ignore spaces and punctuation). there is no spoon The vocabulary i…