Question 13
When adapting a pretrained CNN to a related task with a relatively small labeled dataset, which training choice is generally the more conservative starting point?
Reinitialize the entire network and use a very large learning rate
Retain pretrained features and update them cautiously, often with a smaller learning rate than newly initialized layers
Freeze the newly added prediction head and update only the old classifier
Randomly permute pretrained channels before optimization