Question 15
Which statements can be true in practice when fine-tuning with small batch sizes?
Freezing BatchNorm running statistics can improve stability.
If the new dataset distribution differs, re-estimating BN stats may help.
Setting BatchNorm to training mode with a batch size of 1 provides an unbiased estimate of the population variance.
Calling .eval() on a BatchNorm layer disables the application of the learned affine parameters (γ, β).