Question 8: Which of the following statements are true w.r.t. AdaDelt…

Select all that apply.

1. A

   In a surface with steep curvature, both vt and ut decrease which stops learning rate from reducing aggressively.

2. B

   At low curvature regions vt starts decreasing and learning rate starts increasing.

3. C

   AdaDelta allows numerator to increase or decrease based on current gradients only.

4. D

   AdaDelta converges quicker than RMSProp Algorithm.