Question 7
Consider a neural network with one hidden layer containing two neurons. The input layer contains 2 neurons and the output layer contains one neuron. ReLU activation is used for the hidden layers and sigmoid is used for the output layer.
Considering weights wij = 0.5 for all weights and biases bi = 0 for all biases. Assuming a dropout probability of 0.5, if an input vector x = [1, -2] is fed to this network, which of the following seems to be the expected output?
0
0.5
0.25
1