Question 12
Top-k sampling
Beam search with the beam size K = 2
Top-p sampling
Exhaustive search
None of these
LLM Quiz 1 25 Feb 2024 — Question 12
Show answer
Correct answers
Beam search with the beam size K = 2
Exhaustive search
Question 12 of 15 in the IIT Madras BS Large Language Models (LLM) Quiz 1 paper sat on 25 Feb 2024, in the January 2024 term (IIT M DEGREE AN2 EXAM QDB2 25 Feb 2024). It carries 4 marks.
More questions from this paper
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider a vocabulary \mathcal{V} = (A, T, C, G) and the corresponding embedding matrix E = \begin{bmatrix} 1 & 0 \ 0 &…
- Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
- Consider the following configuration for the Vannila transformer architecture with one encoder layer and one decoder la…
- Figure question
- Suppose we run the pre-trained GPT model in an autoregressive fashion for generating a text sequence. Then, the stateme…
- Suppose we have a dataset for machine translation tasks with thousands of samples. Suppose a team considers training th…
- A team trained a Language model using the GPT architecture using a large corpus of text. The model configurations are g…
- Choose the correct statements
- Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
- Consider a GPT model used for Causal language modelling. We feed the input sentence “This is a cool idea” to the model …
- The statement that “the Next Sentence Prediction (NSP) task requires the BERT model to run autoregressively given the f…