Quiz Space

Large Language Models · Quiz 2 · 24 Mar 2024 · January 2024 term

Question 6: The strikeout words in the passage given below denote the…

Question 6

+4 marksOne or more correct options

The strikeout words in the passage given below denote the words to be dropped from the original sentence. “At the heart of science is an essential balance between two seemingly contradictory attitudes — an openness to new ideas, no matter how bizarre or counterintuitive they may be, and the most ruthless skeptical scrutiny of all ideas, old and new. This is how deep truths are winnowed from deep nonsense”

Which of the following represents the correct input sequence, with sentinel tokens, to the baseline model that uses the pre-training denoising objective? [z] represents the end of the sentinel token in a sentence. The characters inside the square brackets are the sentinel tokens

Select all that apply.

  1. A

    [v] of science is [w] contradictory attitudes [x] counterintuitive they may be [y] how deep truths are winnowed [z]

  2. B

    [a] of science is [b] contradictory attitudes [c] counterintuitive they may be [d] how deep truths are winnowed [z]

  3. C

    [v] of science is [w] contradictory attitudes [x] counterintuitive they may be [y] how deep truths are winnowed

  4. D

    [a] of science is [b] contradictory attitudes [c] counterintuitive they may be [d] how deep truths are winnowed

  5. E

    [w] contradictory attitudes [v] of science is [x] counterintuitive they may be [y] how deep truths are winnowed [z]

  6. F

    [v] of science is [v] contradictory attitudes [x] counterintuitive they may be [x] how deep truths are winnowed [y]

Show answer

Correct answers

  • C

    [v] of science is [w] contradictory attitudes [x] counterintuitive they may be [y] how deep truths are winnowed

  • D

    [a] of science is [b] contradictory attitudes [c] counterintuitive they may be [d] how deep truths are winnowed

Question 6 of 14 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 4 marks.

More questions from this paper

  1. Q1Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  2. Q2Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  3. Q3Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  4. Q4Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  5. Q5Suppose we have two decoder-only models, namely Model A and Model B. Assume we have two datasets, one for unsupervised …
  6. Q7Which of the following models uses a form of denoising objective for pre-training?
  7. Q8Which of the following statements is (are) correct under this setup?
  8. Q9Which of the following modifications will improve the performance of both models?
  9. Q10Consider a summarization task. Assume the prefix is “Summarize the following:” and the input sentence is “There are a l…
  10. Q11Suppose we are given a Model A with N layers and the dataset with D tokens. Choose the correct statements according to …
  11. Q12Which of the following components in the data pre-processing pipeline removes pages that contain bad words?
  12. Q13Suppose a team wants to build a dataset for a low-resource language. They took all Wikipedia dumps for that language an…
  13. Q14The statement that the presence of significant duplicate contents in the pre-training dataset degrades the performance …