Question 22
Consider the following fixed neural network implemented in PyTorch.
Loss function used:
Based on the above data, answer the given subquestions.
For the input:
The network output is:
Recall:
What is the gradient of the loss with respect to the hidden layer activations
(i.e.
[ 0.334, 0.334]
[ 0.334, -0.334]
[-0.334, 0.334]
[ 0.111, -0.111]