Quiz Space

Large Language Models · Quiz 2 · 24 Mar 2024 · January 2024 term

Question 10: Consider a summarization task. Assume the prefix is “Sum…

Question 10

+5 marksOne or more correct options

Consider a summarization task. Assume the prefix is “Summarize the following:” and the input sentence is “There are a lot of videos on YouTube etc. that give the appearance of education, but if you look closely they are really just entertainment. This is very convenient for everyone involved: the people watching enjoy thinking they are learning (but they are just having fun)” and the model is supposed to summarize it.Then which of the following architectures could be used for this task

Select all that apply.

  1. A

    A decoder-only model with a causal mask

  2. B

    A decoder-only model with a prefix mask

  3. C

    An encoder-only model with a fully visible mask

  4. D

    Encoder-Decoder model with fully visible mask in the encoder and causal mask in the decoder

Show answer

Correct answers

  • A

    A decoder-only model with a causal mask

  • B

    A decoder-only model with a prefix mask

  • D

    Encoder-Decoder model with fully visible mask in the encoder and causal mask in the decoder

See the whole paperTake it as a mock test

Question 10 of 14 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 5 marks.

More questions from this paper

  1. Q1Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  2. Q2Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  3. Q3Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  4. Q4Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  5. Q5Suppose we have two decoder-only models, namely Model A and Model B. Assume we have two datasets, one for unsupervised …
  6. Q6The strikeout words in the passage given below denote the words to be dropped from the original sentence. “At the heart…
  7. Q7Which of the following models uses a form of denoising objective for pre-training?
  8. Q8Which of the following statements is (are) correct under this setup?
  9. Q9Which of the following modifications will improve the performance of both models?
  10. Q11Suppose we are given a Model A with N layers and the dataset with D tokens. Choose the correct statements according to …
  11. Q12Which of the following components in the data pre-processing pipeline removes pages that contain bad words?
  12. Q13Suppose a team wants to build a dataset for a low-resource language. They took all Wikipedia dumps for that language an…
  13. Q14The statement that the presence of significant duplicate contents in the pre-training dataset degrades the performance …