Quiz Space

Large Language Models · Quiz 1 · 25 Feb 2024 · January 2024 term

LLM Quiz 1 25 Feb 2024 — Question 11

Question 11

+4 marksOne or more correct options

Choose the correct statements

Select all that apply.

  1. A

    All the parameters of the GPT model are randomly initialized during pre- training

  2. B

    The model minimizes the CLM objective during fine-tuning to improve the performance

  3. C

    All parameters of the GPT model are randomly initialized during fine-tuning

  4. D

    In general, fine-tuning requires a dataset with labels

Show answer

Correct answers

  • A

    All the parameters of the GPT model are randomly initialized during pre- training

  • D

    In general, fine-tuning requires a dataset with labels

See the whole paperTake it as a mock test

Question 11 of 15 in the IIT Madras BS Large Language Models (LLM) Quiz 1 paper sat on 25 Feb 2024, in the January 2024 term (IIT M DEGREE AN2 EXAM QDB2 25 Feb 2024). It carries 4 marks.

This question was also asked in

More questions from this paper

  1. Q1Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
  2. Q2Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
  3. Q3Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
  4. Q4Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
  5. Q5Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
  6. Q6Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
  7. Q7Figure question
  8. Q8Suppose we run the pre-trained GPT model in an autoregressive fashion for generating a text sequence. Then, the stateme…
  9. Q9Suppose we have a dataset for machine translation tasks with thousands of samples. Suppose a team considers training th…
  10. Q10A team trained a Language model using the GPT architecture using a large corpus of text. The model configurations are g…
  11. Q12Figure question
  12. Q13Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
  13. Q14Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
  14. Q15The statement that “the Next Sentence Prediction (NSP) task requires the BERT model to run autoregressively given the f…