Question 7
Which of the following models uses a form of denoising objective for pre-training?
BERT
GPT-1 and GPT-2
BART
T5
Question 7: Which of the following models uses a form of denoising ob…
Show answer
Correct answers
BERT
BART
T5
Question 7 of 14 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 3 marks.
More questions from this paper
- Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
- Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
- Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
- Three teams, namely A, B, and C, decided to use a GPT model with two decoder layers with the following configuration le…
- Suppose we have two decoder-only models, namely Model A and Model B. Assume we have two datasets, one for unsupervised …
- The strikeout words in the passage given below denote the words to be dropped from the original sentence. “At the heart…
- Which of the following statements is (are) correct under this setup?
- Which of the following modifications will improve the performance of both models?
- Consider a summarization task. Assume the prefix is “Summarize the following:” and the input sentence is “There are a l…
- Suppose we are given a Model A with N layers and the dataset with D tokens. Choose the correct statements according to …
- Which of the following components in the data pre-processing pipeline removes pages that contain bad words?
- Suppose a team wants to build a dataset for a low-resource language. They took all Wikipedia dumps for that language an…
- The statement that the presence of significant duplicate contents in the pre-training dataset degrades the performance …