Quiz Space

Deep Learning · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 4: Which of the following optimization algorithms adapts the…

Question 4

+3 marksOne or more correct options

Which of the following optimization algorithms adapts the learning rate based on the current gradient and the history of gradients?

Select all that apply.

  1. A

    Gradient Descent with exponentially decaying learning rate

  2. B

    RMSProp

  3. C

    Nesterov Accelerated Gradient Descent with step decay

  4. D

    ADAM

  5. E

    Ada-Delta

Show answer

Correct answers

  • B

    RMSProp

  • D

    ADAM

  • E

    Ada-Delta

See the whole paperTake it as a mock test

Question 4 of 23 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 3 marks.

More questions from this paper

  1. Q1Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  2. Q2Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  3. Q3Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  4. Q5Which of the following are regularization technique(S)?
  5. Q6Which of the following activation function(s) is (are) prone to vanishing gradient problem?
  6. Q7Which optimization algorithm combines the advantages of RM-Sprop and momentum?
  7. Q8What is the key reason for the development of adaptive optimization algorithms like RMSprop and Adam?
  8. Q9What is the derivative of the Leaky ReLU activation function with respect to its input?
  9. Q10Which of the following options represents the correct ordering in terms of the bias of the models illustrated in the im…
  10. Q11Which of the following is a common form of regularization that involves adding a penalty proportional to the square of …
  11. Q12Figure question
  12. Q13Which architecture has fewer parameters (CONV or FC)?
  13. Q14What is the difference in the number of trainable parameters between these two neural architectures?
  14. Q15Which of the following statements is/are true about a CONV layer?
  15. Q16Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  16. Q17Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  17. Q18Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  18. Q19Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  19. Q20Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  20. Q21Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  21. Q22Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  22. Q23Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…