Question 5
Suppose we have two decoder-only models, namely Model A and Model B. Assume we have two datasets, one for unsupervised pre-training (Web-Text) and the other for supervised training (text summarization). Model A was trained directly on the training set of the supervised dataset. Model B was trained on the pre-training dataset using the CLM objective. Suppose we want to test the performance of both models on the test set of summarization task. Then choose the correct statements
Model A can directly be used on the test set
It is possible to use Model B directly on the test set without fine-tuning on the training set
Model B should be fine-tuned first on the training set and then use the test set.