Quiz Space

Large Language Models · End Term · 31 Aug 2025 · May 2025 term · Set QDB1

Question 4: A GPT-based model is fine-tuned for story generation. Dur…

Question 4

+3 marksOne or more correct options

A GPT-based model is fine-tuned for story generation. During evaluation, you test different decoding strategies on the same prompt:
1. Method A: Every run produces the exact same story, even when executed multiple times. 2. Method B: The story changes slightly in each run, but overall structure and key events remain similar.
3. Method C: The story is wildly different each time, sometimes even changing the genre. Based on the observations, select the most likely decoding strategies for each method:

Select all that apply.

  1. A

    Method A: Greedy decoding

  2. B

    Method A: Top-K sampling with K = 50

  3. C

    Method B: Top-P sampling with p = 0.9

  4. D

    Method C: Top-P sampling with p = 0.5 and high temperature T = 1.5

  5. E

    Method C: Beam search with K = 5

Show answer

Correct answers

  • A

    Method A: Greedy decoding

  • C

    Method B: Top-P sampling with p = 0.9

  • D

    Method C: Top-P sampling with p = 0.5 and high temperature T = 1.5

See the whole paperTake it as a mock test

Question 4 of 17 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 31 Aug 2025, in the May 2025 term (IIT M DEGREE AN EXAM QDB3 31 Aug 2025). It carries 3 marks.

More questions from this paper

  1. Q1Given the input string: moonlight And the following vocabulary of subword tokens with their corresponding log-probabili…
  2. Q2Figure question
  3. Q3Which of the following statements about subword tokenizers (e.g., Byte Pair Encoding, SentencePiece) is true?
  4. Q5Which of the following are valid design choices when building a transformer-based language model?
  5. Q6Which of the following statements about Top-k and Nucleus (Top-p) sampling are correct?
  6. Q7Which of the following preprocessing steps are commonly required when preparing data for transformer models like BERT?
  7. Q8Suppose a language model outputs the following logits for a vocabulary of size 4: | Token | Logit | |---|---| | cat | 1…
  8. Q9For the input “you enjoy tea often”, compute the final representation of the word “tea” after the attention layer (i.e.…
  9. Q10Suppose the input sentence is “tea you enjoy often”. Using the same matrices and processing method, what is the attenti…
  10. Q11Figure question
  11. Q12Figure question
  12. Q13What percentage of entries in the attention matrix are zero (i.e., the sparsity)?
  13. Q14Consider the short sentence: “large language models are cool” A transformer processes this sequence using the naive rel…
  14. Q15Consider the short sentence: “large language models are cool” A transformer processes this sequence using the naive rel…
  15. Q16Consider the short sentence: “large language models are cool” A transformer processes this sequence using the naive rel…
  16. Q17Consider the short sentence: “large language models are cool” A transformer processes this sequence using the naive rel…