Quiz Space

Large Language Models · End Term · 13 Apr 2025 · January 2025 term · Set 1

Question 5: Suppose we have a dataset for machine translation tasks w…

Question 5

+2 marksOne or more correct options

Suppose we have a dataset for machine translation tasks with thousands of samples. Suppose a team considers training the transformer model. The model could be trained using two approaches
A. Autoregressive training B. Teacher forcing
Choose the correct statements

Select all that apply.

  1. A

    Approach A helps the model to converge faster than approach B

  2. B

    Approach B helps the model to converge faster than approach A

  3. C

    One can start the training with approach B first and then switch to approach Aafter some training steps

  4. D

    Once the training starts with approach A and then switching to approach Bafter some training steps cannot be done

Show answer

Correct answers

  • B

    Approach B helps the model to converge faster than approach A

  • C

    One can start the training with approach B first and then switch to approach Aafter some training steps

Question 5 of 15 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M DEGREE FN EXAM QDB2 13 Apr 2025). It carries 2 marks.

This question was also asked in

More questions from this paper

  1. Q1Suppose we are given a Model A with N layers and a dataset with D tokens. Choose the correct statements according to th…
  2. Q2The statement that KV caching is not helpful during inference in encoder models like BERT is
  3. Q3Consider the problem of length extrapolation using the Absolute Position Encoding (APE) scheme. Suppose the context len…
  4. Q4Select correct statements about sinusoidal positional encoding:
  5. Q6Select correct statements regarding character level tokenization:\ Note: Assume that the character level vocabulary has…
  6. Q7Which of the following are design choices for building a large language model?
  7. Q8Figure question
  8. Q9Figure question
  9. Q10Consider following distribution generated by a GPT model after feeding the sentence “I love Manali because it is so”: C…
  10. Q11Consider following distribution generated by a GPT model after feeding the sentence “I love Manali because it is so”: C…
  11. Q12Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
  12. Q13Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
  13. Q14Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
  14. Q15Of these 4 blocks, choose the block(s) that is (are) proper permutation of 4 blocks.