Quiz Space

Deep Learning · Quiz 2 · 24 Mar 2024 · January 2024 term

Question 10: Which of the following optimization algorithms encounter…

Question 10

+4 marksOne or more correct options

Which of the following optimization algorithms encounter problem of oscillating around the minima?

Select all that apply.

  1. A

    AdaGrad

  2. B

    RMSProp

  3. C

    Nesterov Accelerated Gradient Descent

  4. D

    ADAM

  5. E

    Momentum Based Gradient Descent

Show answer

Correct answers

  • B

    RMSProp

  • C

    Nesterov Accelerated Gradient Descent

  • D

    ADAM

  • E

    Momentum Based Gradient Descent

See the whole paperTake it as a mock test

Question 10 of 16 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 4 marks.

More questions from this paper

  1. Q1What are the possible outcomes if we don’t do bias correction in ADAM?
  2. Q2Consider the assertion and the corresponding reason,\ Assertion (A): The RMSProp Algorithm starts oscillating around th…
  3. Q3Suppose you have a deep neural network trained on a dataset with a small amount of labeled examples. After applying L2 …
  4. Q4What are the maximum and minimum possible values of the derivative of sigmoid function?
  5. Q5Consider a feed-forward neural network containing three inputs and one output. It contains 50 hidden layers, each conta…
  6. Q6Suppose we have a neural network with two hidden layers, each containing two neurons. The network contains two inputs a…
  7. Q7Consider a neural network with one hidden layer containing two neurons. The input layer contains 2 neurons and the outp…
  8. Q8Which of the following statements are true w.r.t. AdaDelta Algorithm?
  9. Q9After training a neural network using vanilla gradient descent, you notice that it performs exceptionally well on the t…
  10. Q11Consider a network where sigmoid activation is used at all hidden layers. Which of the following will be true?
  11. Q12Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  12. Q13Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  13. Q14Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  14. Q15What is the value of stride s?. Assume zero padding (p = 0)
  15. Q16How many parameters (excluding bias) are there in the convolutional layer?