Quiz Space

Large Language Models · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 4: Consider the following dictionary with the number of word…

Question 4

+2 marksNumerical answer

Consider the following dictionary with the number of word occurrences in a corpus:

python
wo =  { "deeper": 5,
        "keener": 6,
        "sweeter": 7,}

Note: Append identifier/special symbol </w> to each word at the end.

You will be learning a byte pair encoding, answer the given subquestions in that context:

What is the frequency of the most frequent byte-pair before the very first merge?

Show answer

Correct answer: 18

See the whole paperTake it as a mock test

Question 4 of 16 in the IIT Madras BS Large Language Models (LLM) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 2 marks.

More questions from this paper

  1. Q1Consider the following dictionary with the number of word occurrences in a corpus: Note: Append identifier/special symb…
  2. Q2Consider the following dictionary with the number of word occurrences in a corpus: Note: Append identifier/special symb…
  3. Q3Consider the following dictionary with the number of word occurrences in a corpus: Note: Append identifier/special symb…
  4. Q5Consider the following dictionary with the number of word occurrences in a corpus: Note: Append identifier/special symb…
  5. Q6Consider the following dictionary with the number of word occurrences in a corpus: Note: Append identifier/special symb…
  6. Q7Consider the following dictionary with the number of word occurrences in a corpus: Note: Identifier/special symbol &lt;…
  7. Q8Consider the following dictionary with the number of word occurrences in a corpus: Note: Identifier/special symbol &lt;…
  8. Q9Which of the following represent(s) the normalization step(s) in building a tokenizer for the English language?
  9. Q10Choose all the aspects of the pre-training datasets that impact the model’s performance.
  10. Q11The strikeout words in the passage given below denote the words to be dropped from the original sentence. “Metacognitio…
  11. Q12Suppose you are working on prefix language modeling. The sequence length is 32 and the first two tokens represent the t…
  12. Q13Which of the following components in the data pre-processing pipeline removes pages that contain bad words?
  13. Q14Which of the following is an important implication of the scaling law:
  14. Q15Which of the following are the design choices for building a large language model?
  15. Q16Consider an ideal data preprocessing pipeline to prepare a dataset. Which of the following sentences or sets of paragra…