Question 16
A team trains a sentiment classifier achieving 94% test accuracy. They discover 200 test reviews accidentally appeared in training data. After removing duplicates and retraining, accuracy drops to 76%. What does this reveal?
Choose the correct answer.
Removing training data naturally reduces accuracy.
The 94% was inflated by test leakage—the model memorized test examples.
The duplicates contained critical patterns needed for learning.
The random seed changed, causing different train-test splits.