Opening the paper…
Deep Learning, End Term
A neural network is being trained for a regression problem in which the target is in the interval (−1, 1). Which of the following is NOT a good choice for the activation function at the output layer?
A neural network is being trained for a regression problem in which the target is in the interval (−1, 1). Which of the following is NOT a good choice for the activation function at the output layer? In the transformer architecture, which of the following are true regarding cross attention in the decoder? Consider applying dropout to a hidden layer with *p* = 0.5. Which of the following are true?