Opening the paper…
Large Language Models, Quiz 2
Time left
02:00:00
Consider following assertion and reason pair:
Assertion: A small vocabulary is desirable, as it reduces the size of the embedding matrix. Reason: Decreasing the size of the vocabulary increases the number of tokens in the input.
Consider following assertion and reason pair:\ **Assertion:** A small vocabulary is desirable, as it reduces the size of the embedding matrix. **Reason:** Decreasing the size of the vocabulary increases the number of tokens in the input. Consider following statement and mark if it is true or false:\ Repeating examples in the pre-training datasets are completely harmless for downstream performance. What is the order of the language modeling pipeline?