Quiz Space

Deep Learning · Quiz 2 · 4 Aug 2024 · May 2024 term

Question 5: How does dropout affect the behavior of the neural networ…

Question 5

+3 marksOne correct option

How does dropout affect the behavior of the neural network during the inference phase?

  1. A

    All neurons are dropped randomly as in the training phase.

  2. B

    Only a subset of neurons is kept active, and their outputs are scaled by the keep probability.

  3. C

    All neurons are active, and their outputs are typically scaled by the keep probability to maintain consistency with the training phase.

  4. D

    Dropout is not applied during the inference phase, and no scaling is necessary.

Show answer

Correct answer

  • C

    All neurons are active, and their outputs are typically scaled by the keep probability to maintain consistency with the training phase.

Question 5 of 16 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 4 Aug 2024, in the May 2024 term (IIT M DEGREE AN EXAM QDB2 4 Aug 2024). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Which of the following statements accurately describes the behavior of the learning rate in the AdaGrad algorithm?
  3. Q3Figure question
  4. Q4What is the primary purpose of using cosine annealing with warm restarts in optimization algorithms?
  5. Q6Which of the following options correctly describes the effect of early stopping as a regularization technique in traini…
  6. Q7You are experimenting with L1 and L2 regularization techniques on a deep neural network trained on a moderately sized d…
  7. Q8What is the impact of using a sigmoid activation function on the gradients when the input to the neuron is a very large…
  8. Q9What is the derivative of the Leaky ReLU activation function with respect to its input?
  9. Q10Which of the following do not suffer from the vanishing gradient problem as well as the dead neurons problem?\ Sigmoid\…
  10. Q11Both sigmoid and tanh activation functions saturate:
  11. Q12You are working on a project where you aim to predict housing prices based on various features. You have split your dat…
  12. Q13Based on the above data, answer the given subquestions.
  13. Q14Pass a through the ReLU activation function and assign the output to h. ReLU(x) = \begin{cases} x, & if\ x \ge 0 \ 0, &…
  14. Q15Consider a Convolutional Neural Network (CNN) architecture for image classification with the following layers:\ Convolu…
  15. Q16Consider an intermediate feature map H obtained after applying convolution operation on the input X using kernel F. H =…