Question 15
What are the maximum values of the derivatives of sigmoid and tanh?
1, 1
0.5, 0.5
0, 0.5
0.5, 0
0.25, 1
0.25, 0.5
Question 15: What are the maximum values of the derivatives of sigmoi…
Show answer
Correct answer
0.25, 1
Question 15 of 25 in the IIT Madras BS Deep Learning (Deep Learning) End Term paper sat on 1 Sept 2024, in the May 2024 term (IIT M DEGREE AN EXAM QDB3 01 Sep 2024). It carries 2 marks.
More questions from this paper
- Figure question
- Consider a dataset with 150 samples and a batch size of 15. If each minibatch iteration contributes an average loss of …
- If you use hierarchical softmax with a binary tree where each leaf node represents a word in the vocabulary, and the vo…
- In a Skip-gram model with a vocabulary size V = 100, an embedding dimension D = 10, and a window size of 3 (on each sid…
- Figure question
- Consider a Transformer model with the following specifications for the decoder part: Input dimension (embedding size): …
- Consider a feedforward neural network with the following structure: One input layer with 2 nodes One hidden layer with …
- A neural network has the following structure: Input Layer: \mathbf{h_0} = \mathbf{x}, where \mathbf{x} \in \mathbb{R}^{…
- Given an input array X and a kernel/filter K as follows: X = \begin{bmatrix} -1 & -1 & 0 & 2 \ -2 & 1 & 0 & 0 \ 1 & -1 …
- What is the derivative of the ReLU activation function at x = 10?
- In terms of convergence speed, which gradient descent method can show the most rapid progress initially but may suffer …
- How does the use of early stopping in training a neural network affect the model’s performance on unseen data?
- Which of the following statements is/are not true with respect to a dropout rate of 0.2?
- In the context of unsupervised pretraining of artificial neural networks, which of the following statements accurately …
- Figure question
- Given a matrix A with dimensions p × q, which of the following statements is NOT true regarding the rank-k approximatio…
- Consider an encoder-decoder model trained with a batch size of 64. Each input sequence has a length of 12 tokens, and e…
- In an encoder-decoder model, what is the significance of the context vector?
- Given the attention weights αt,1 = 0.3, αt,2 = 0.4, αt,3 = 0.3 and the corresponding encoder hidden states h1 = [2, 1, …
- In the Transformer model, what is the purpose of the multi-head attention mechanism?
- In the context of the Transformer model’s encoder-decoder architecture, which of the following statements are correct?
- In a time series prediction task using a GRU (Gated Recurrent Unit) network, the GRU processes input sequences where ea…
- In a time series prediction task using a GRU (Gated Recurrent Unit) network, the GRU processes input sequences where ea…
- In a time series prediction task using a GRU (Gated Recurrent Unit) network, the GRU processes input sequences where ea…