Question 8
Suppose we run the pre-trained GPT model in an autoregressive fashion for generating a text sequence. Then, the statement that “ We do not need to add the positional embedding to the predicted tokens at every time step” is
TRUE
FALSE
Question 8: Suppose we run the pre-trained GPT model in an autoregres…
Show answer
Correct answer
TRUE
Question 8 of 15 in the IIT Madras BS Large Language Models (LLM) Quiz 1 paper sat on 25 Feb 2024, in the January 2024 term (IIT M DEGREE AN2 EXAM QDB2 25 Feb 2024). It carries 4 marks.
More questions from this paper
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
- Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
- Figure question
- Suppose we have a dataset for machine translation tasks with thousands of samples. Suppose a team considers training th…
- A team trained a Language model using the GPT architecture using a large corpus of text. The model configurations are g…
- Choose the correct statements
- Figure question
- Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
- Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
- The statement that “the Next Sentence Prediction (NSP) task requires the BERT model to run autoregressively given the f…