Question 15: Consider the following statements related to optimizatio…

Select all that apply.

1. A

   Step decay, exponential decay, and cosine decay are examples of learning rate scheduling techniques.

2. B

   Accelerated gradient methods necessarily require the learning rate to decrease over time in order to converge.

3. C

   Momentum-based methods can improve convergence speed even when the learning rate is kept constant.

4. D

   Learning rate scheduling methods introduce memory of past gradients into the optimization process.

5. E

   Learning rate scheduling and accelerated gradient methods can be used together.