Quiz Space

Large Language Models · Quiz 2 · 24 Mar 2024 · January 2024 term

Question 13: Suppose a team wants to build a dataset for a low-resour…

Question 13

+3 marksOne correct option

Suppose a team wants to build a dataset for a low-resource language. They took all Wikipedia dumps for that language and found that the dataset size was insufficient. Then the statement that using years of Common Crawl Snapshots would be helpful to increase the size of the dataset is

  1. A

    TRUE

  2. B

    FALSE

Show answer

Correct answer

  • A

    TRUE

See the whole paperTake it as a mock test

Question 13 of 14 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 3 marks.

More questions from this paper

  1. Q1Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  2. Q2Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  3. Q3Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  4. Q4Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
  5. Q5Suppose we have two decoder-only models, namely Model A and Model B. Assume we have two datasets, one for unsupervised …
  6. Q6The strikeout words in the passage given below denote the words to be dropped from the original sentence. “At the heart…
  7. Q7Which of the following models uses a form of denoising objective for pre-training?
  8. Q8Which of the following statements is (are) correct under this setup?
  9. Q9Which of the following modifications will improve the performance of both models?
  10. Q10Consider a summarization task. Assume the prefix is “Summarize the following:” and the input sentence is “There are a l…
  11. Q11Suppose we are given a Model A with N layers and the dataset with D tokens. Choose the correct statements according to …
  12. Q12Which of the following components in the data pre-processing pipeline removes pages that contain bad words?
  13. Q14The statement that the presence of significant duplicate contents in the pre-training dataset degrades the performance …