Question 10
Suppose that a model produces zero training error without using any regularization technique. What happens if we use L2 regularization and retrain the model, in general?
This might increase training error
This might decrease test error
Reduce the complexity of the model by driving less important weights to close to zero
This might decrease training error