Deep Learning for Computer Vision Quiz 1 27 Oct 2024 — Question 11

Select all that apply.

1. A

   Momentum in optimization can cause oscillations around minima when encountering flat regions or saddle points due to the dominance of the momentum term over the small gradient.

2. B

   Stochastic Gradient Descent (SGD) with its inherent noise can be beneficial in escaping local minima and saddle points, provided that there is enough gradient information in the neighborhood.

3. C

   Adagrad is an optimization algorithm introduced to overcome the diminishing learning rate problem in techniques like RMSProp.

4. D

   ADAM is introduced to solve problems in RMSProp by combining RMSProp and Adagrad techniques.