Question 6
You have a pretrained CNN backbone and only 500 labeled images for a new task. A strong first baseline is:
Fine-tune the entire network immediately using a very small learning rate to preserve pre-trained features
Freeze backbone, train a new classifier head; optionally unfreeze later with smaller LR
Train a completely new architecture from scratch using heavy data augmentation to compensate for the lack of data
Unfreeze the backbone from the bottom layers upwards, gradually increasing the learning rate