Large Language Models Quiz 2: 23 November 2025 (September 2025 term)

A corpus containing the following five words is tokenized using WordPiece algorithm.

Table 1: Word frequencies in the corpus before any merges

The initial character-level vocabulary is:

$V_0 = \{\text{‘p’}, \text{‘r’}, \text{‘l’}, \text{‘a’}, \text{‘y’}, \text{‘e’}, \text{‘d’}, \text{‘i’}, \text{‘n’}, \text{‘g’}, < w >\}.$

Based on the above data, answer the given subquestions.

A corpus containing the following five words is tokenized using WordPiece algorithm.

Table 1: Word frequencies in the corpus before any merges

The initial character-level vocabulary is:

$V_0 = \{\text{‘p’}, \text{‘r’}, \text{‘l’}, \text{‘a’}, \text{‘y’}, \text{‘e’}, \text{‘d’}, \text{‘i’}, \text{‘n’}, \text{‘g’}, < w >\}.$

Based on the above data, answer the given subquestions.

A corpus containing the following five words is tokenized using WordPiece algorithm.

Table 1: Word frequencies in the corpus before any merges

The initial character-level vocabulary is:

$V_0 = \{\text{‘p’}, \text{‘r’}, \text{‘l’}, \text{‘a’}, \text{‘y’}, \text{‘e’}, \text{‘d’}, \text{‘i’}, \text{‘n’}, \text{‘g’}, < w >\}.$

Based on the above data, answer the given subquestions.

Which token will be generated in the first merge?