Question 1
Why do very deep plain CNNs (without skip connections) sometimes show higher training error than shallower CNNs?
They always overfit because parameter count increases.
Optimization becomes harder; skip connections make learning identity mappings easier and improve gradient flow.
BatchNorm guarantees this never happens.
Using sigmoid activations instead of ReLU always fixes it.