Quiz Space

Deep Learning · End Term · 21 Dec 2025 · September 2025 term

Question 13: Why is the sigmoid activation function often preferred o…

Question 13

+3 marksOne or more correct options

Why is the sigmoid activation function often preferred over the step activation function in neural networks?

Select all that apply.

  1. A

    The sigmoid is differentiable, allowing gradient-based optimization methods like backpropagation.

  2. B

    The step function is non-differentiable and does not support learning through gradient descent.

  3. C

    The sigmoid function completely avoids vanishing gradient problems.

  4. D

    The step function outputs values in the range (0,1), whereas the sigmoid outputs only discrete values {0,1}.

Show answer

Correct answers

  • A

    The sigmoid is differentiable, allowing gradient-based optimization methods like backpropagation.

  • B

    The step function is non-differentiable and does not support learning through gradient descent.

Question 13 of 32 in the IIT Madras BS Deep Learning (Deep Learning) End Term paper sat on 21 Dec 2025, in the September 2025 term (Deep Learning 18 Dec 25). It carries 3 marks.

More questions from this paper

  1. Q1What is a co-occurrence matrix in the context of Natural Language Processing?
  2. Q2What is the primary advantage of word embeddings compared to one-hot encoding?
  3. Q3Which of the following is not true about multi-head cross attention?
  4. Q4What is the primary advantage of Transformer encoders over RNN encoders for long sequences?
  5. Q5Figure question
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Which of the following optimizers use momentum (or momentum-like mechanisms) in updating gradients?
  9. Q9Regarding the specific gating mechanisms used to control information flow and gradients in LSTMs and GRUs, which statem…
  10. Q10Which of the following statements are true for the saturated neurons problem? Select all that apply.
  11. Q11Figure question
  12. Q12You are training a deep feedforward neural network (100 layers) for binary classification with a sigmoid output with ta…
  13. Q14Figure question
  14. Q15Consider the sigmoid activation function defined as:
  15. Q16Figure question
  16. Q17Figure question
  17. Q18Figure question
  18. Q19Based on the above data, answer the given subquestions.
  19. Q20Figure question
  20. Q21Identify the word in the vocabulary with the highest predicted probability for the missing word (???), and provide its …
  21. Q22Based on the above data, answer the given subquestions.
  22. Q23Figure question
  23. Q24Based on the above data, answer the given subquestions.
  24. Q25Identify the word in the vocabulary that has the highest probability of being predicted as a context word given the cen…
  25. Q26Based on the above data, answer the given subquestions.
  26. Q27How many total weights from Win and Wout combined will be updated?
  27. Q28Based on the above data, answer the given subquestions.
  28. Q29The previous decoder hidden state is: and Based on the above data, answer the given subquestions.
  29. Q30Based on the above data, answer the given subquestions.
  30. Q31The previous decoder hidden state is: and Based on the above data, answer the given subquestions.
  31. Q32The previous decoder hidden state is: and Based on the above data, answer the given subquestions.