Quiz Space

Deep Learning · Quiz 2 · 24 Mar 2024 · January 2024 term

Question 5: Consider a feed-forward neural network containing three i…

Question 5

+3 marksOne correct option

Consider a feed-forward neural network containing three inputs and one output. It contains 50 hidden layers, each containing two neurons. The activation function used in all the hidden layers is ReLU, the output layer uses the Sigmoid activation function for binary classification. The network is trained with a binary cross-entropy loss function.
Assume all weights are initialized to 1 and all biases to 0. For an input of [-10, 5, -20], what will be the output of the neural network?

  1. A

    0

  2. B

    1

  3. C

    0.5

  4. D

    0.25

  5. E

    -25

  6. F

    Insufficient information

Show answer

Correct answer

  • C

    0.5

See the whole paperTake it as a mock test

Question 5 of 16 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 24 Mar 2024, in the January 2024 term (IIT M DEGREE AN EXAM QDB2 24 Mar 2024). It carries 3 marks.

More questions from this paper

  1. Q1What are the possible outcomes if we don’t do bias correction in ADAM?
  2. Q2Consider the assertion and the corresponding reason,\ Assertion (A): The RMSProp Algorithm starts oscillating around th…
  3. Q3Suppose you have a deep neural network trained on a dataset with a small amount of labeled examples. After applying L2 …
  4. Q4What are the maximum and minimum possible values of the derivative of sigmoid function?
  5. Q6Suppose we have a neural network with two hidden layers, each containing two neurons. The network contains two inputs a…
  6. Q7Consider a neural network with one hidden layer containing two neurons. The input layer contains 2 neurons and the outp…
  7. Q8Which of the following statements are true w.r.t. AdaDelta Algorithm?
  8. Q9After training a neural network using vanilla gradient descent, you notice that it performs exceptionally well on the t…
  9. Q10Which of the following optimization algorithms encounter problem of oscillating around the minima?
  10. Q11Consider a network where sigmoid activation is used at all hidden layers. Which of the following will be true?
  11. Q12Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  12. Q13Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  13. Q14Consider an Input matrix X of shape 4×4 and the kernel (filter) of shape 3×3 with a bias b = 1. Assume, stride equals 1…
  14. Q15What is the value of stride s?. Assume zero padding (p = 0)
  15. Q16How many parameters (excluding bias) are there in the convolutional layer?