Question 21
Consider the following fixed neural network implemented in PyTorch.
Loss function used: Based on the above data, answer the given subquestions.
For the input:
The network output is: Recall:
What is the gradient of the loss with respect to the hidden layer activations (i.e. )?
[ 0.334, 0.334]
[ 0.334, -0.334]
[-0.334, 0.334]
[ 0.111, -0.111]