Quiz Space

Deep Learning · Quiz 2 · 16 Mar 2025 · January 2025 term

Question 1: What is the impact of using a sigmoid activation function…

Question 1

+3 marksOne correct option

What is the impact of using a sigmoid activation function on the gradients when the input to the neuron is a very large negative number?

  1. A

    The output approaches 0 and the gradient approaches 0.

  2. B

    The output approaches 0.5 and the gradient approaches 0.25.

  3. C

    The output approaches 1 and the gradient approaches 0.

  4. D

    The output approaches 0 and the gradient approaches 1.

Show answer

Correct answer

  • A

    The output approaches 0 and the gradient approaches 0.

See the whole paperTake it as a mock test

Question 1 of 23 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 16 Mar 2025, in the January 2025 term (IIT M DEGREE AN EXAM QDB2 16 Mar 2025). It carries 3 marks.

This question was also asked in

More questions from this paper

  1. Q2Why is bias correction needed in the Adam optimizer?
  2. Q3How do skip connections in ResNet work?
  3. Q4What is the primary purpose of L2 regularization in machine learning models?
  4. Q5What is the soft target used when injecting noise at the output?
  5. Q6Consider a neural network architecture for a regression task. Three distinct subsets of the training dataset are used t…
  6. Q7The weighted moving average (WMA) is used to smooth data by giving more importance to recent values. Suppose we compute…
  7. Q8Given an input array X and a kernel/filter K as follows: X = \begin{bmatrix} 1 & 0 & -2 & 1 \ 1 & 2 & 0 & 1 \ -1 & -1 &…
  8. Q9Given an input array X and a kernel/filter K as follows: X = \begin{bmatrix} 1 & 0 & -2 & 1 \ 1 & 2 & 0 & 1 \ -1 & -1 &…
  9. Q10Given an input array X and a kernel/filter K as follows: X = \begin{bmatrix} 1 & 0 & -2 & 1 \ 1 & 2 & 0 & 1 \ -1 & -1 &…
  10. Q11Consider a loss function, L(w) = w^3 + 2w, where w represents the model parameter. The AdaGrad optimizer is used to min…
  11. Q12Consider a loss function, L(w) = w^3 + 2w, where w represents the model parameter. The AdaGrad optimizer is used to min…
  12. Q13Consider a loss function, L(w) = w^3 + 2w, where w represents the model parameter. The AdaGrad optimizer is used to min…
  13. Q14Consider a loss function, L(w) = w^3 + 2w, where w represents the model parameter. The AdaGrad optimizer is used to min…
  14. Q15Based on the above data, answer the given subquestions.
  15. Q16Based on the above data, answer the given subquestions.
  16. Q17Based on the above data, answer the given subquestions.
  17. Q18Based on the above data, answer the given subquestions.
  18. Q19Based on the above data, answer the given subquestions.
  19. Q20Based on the above data, answer the given subquestions.
  20. Q21Based on the above data, answer the given subquestions.
  21. Q22Based on the above data, answer the given subquestions.
  22. Q23Based on the above data, answer the given subquestions.