Large Language Models, End Term

January 2025 term, 13 Apr 2025, Set 1

Learning mode

Question 1

+2−0Single correct

Suppose we are given a Model A with N layers and a dataset with D tokens. Choose the correct statements according to the scaling law.

A.
Increasing the model size requires a proportionate increase in the dataset sizeto reduce the test loss
B.
Increasing the model size requires a proportionate increase in the dataset sizeto reduce the training loss
C.
Increasing the model size requires us to double the dataset size to reduce thetest loss
D.
Increasing the model size requires us to double the dataset size to reduce thetrain loss