Question 14
Which statements can be true in practice when fine-tuning with small batch sizes?
Freezing BatchNorm running statistics can improve stability.
If the new dataset distribution differs, re-estimating BN stats may help.
BN always improves performance even with batch size 1.
Setting BN to eval disables learned affine parameters (γ, β).