Quiz Space

Deep Learning · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 9: What is the derivative of the Leaky ReLU activation funct…

Question 9

+2 marksOne correct option

What is the derivative of the Leaky ReLU activation function with respect to its input?

  1. A

    0 for negative inputs, 1 for positive inputs.

  2. B

    1 for negative inputs, 0 for positive inputs.

  3. C

    0.01 for negative inputs, 1 for positive inputs.

  4. D

    0.05 for negative inputs, 1 for positive inputs.

  5. E

    1 for all inputs.

Show answer

Correct answer

  • C

    0.01 for negative inputs, 1 for positive inputs.

See the whole paperTake it as a mock test

Question 9 of 23 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 2 marks.

This question was also asked in

More questions from this paper

  1. Q1Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  2. Q2Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  3. Q3Given a quadratic loss function L(w) = w^2, where w represents the model parameter, you are using the AdaGrad optimizer…
  4. Q4Which of the following optimization algorithms adapts the learning rate based on the current gradient and the history o…
  5. Q5Which of the following are regularization technique(S)?
  6. Q6Which of the following activation function(s) is (are) prone to vanishing gradient problem?
  7. Q7Which optimization algorithm combines the advantages of RM-Sprop and momentum?
  8. Q8What is the key reason for the development of adaptive optimization algorithms like RMSprop and Adam?
  9. Q10Which of the following options represents the correct ordering in terms of the bias of the models illustrated in the im…
  10. Q11Which of the following is a common form of regularization that involves adding a penalty proportional to the square of …
  11. Q12Figure question
  12. Q13Which architecture has fewer parameters (CONV or FC)?
  13. Q14What is the difference in the number of trainable parameters between these two neural architectures?
  14. Q15Which of the following statements is/are true about a CONV layer?
  15. Q16Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  16. Q17Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  17. Q18Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  18. Q19Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  19. Q20Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  20. Q21Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  21. Q22Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…
  22. Q23Consider the below deep neural architecture, being applied on an image of size 128 × 128 with 3 channels of R-G-B. Assu…