Quiz Space

Deep Learning · Quiz 2 · 3 Dec 2023 · September 2023 term

Question 4: Which of the following optimization algorithms adapts the…

Question 4

+3 marksOne or more correct options

Which of the following optimization algorithms adapts the learning rate based on the current gradient and history of gradients?

Select all that apply.

  1. A

    Gradient Descent with exponentially decaying learning rate

  2. B

    RMSProp

  3. C

    Nesterov Accelerated Gradient Descent with step decay

  4. D

    ADAM

  5. E

    Ada-Delta

Show answer

Correct answers

  • B

    RMSProp

  • D

    ADAM

  • E

    Ada-Delta

See the whole paperTake it as a mock test

Question 4 of 17 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 3 Dec 2023, in the September 2023 term (IIT M DEGREE AN2 EXAM QDB2 03 Dec 2023). It carries 3 marks.

More questions from this paper

  1. Q1The statement that the bias correction in ADAM optimizer is an absolute requirement for it to converge to a local minim…
  2. Q2Team A constructs a dataset \mathcal{D} = {X, y} that contains N samples. Each sample x_i \in \mathbb{R} is uniformly s…
  3. Q3Figure question
  4. Q5In general, applying regularization to an over-fitted deep learning model
  5. Q6Assume a team has trained a CNN model for image classification. They observed that the model was performing poorly (tha…
  6. Q7Figure question
  7. Q8The statement that,“ The gradient of the weight w changes slowly as compared to the gradient of the bias b if we move o…
  8. Q9The statement that,“the gradient of the bias b changes rapidly as compared to the gradient of the weight w if we move o…
  9. Q10The statement that,“The algorithm converged to the (local or global) minimum after 500 iterations” is
  10. Q11The dimension of C1 = 101 × 101 × 100. Suppose we use 25 kernels (filters) of shape 3 × 3, with stride 1 and no zero pa…
  11. Q12We know that the shape of the flattened layer is N × 1. What is the value of N ?(If your answer is 1050,enter 1050)
  12. Q13Suppose we feed in the features F of dimension N × 1 to a fully connected layer with 4 neurons (assume no bias) with th…
  13. Q14Based on the above data, answer the given subquestions.
  14. Q15Based on the above data, answer the given subquestions.
  15. Q16Based on the above data, answer the given subquestions.
  16. Q17Based on the above data, answer the given subquestions.