Quiz Space

Deep Learning · Quiz 2 · 6 Aug 2023 · May 2023 term

Question 6: We know that the weight update rule for gradient descent …

Question 6

+5 marksOne or more correct options

We know that the weight update rule for gradient descent algorithm is given by

wt+1=wt−ηt∇wtw_{t+1} = w_t - \eta_t \nabla w_t

which is equivalently written as

wt+1=w0−ηt∑i=1t∇wiw_{t+1} = w_0 - \eta_t \sum_{i=1}^{t} \nabla w_i

Choose all the correct bounds

Select all that apply.

  1. A
  2. B
  3. C
  4. D
Show answer

Correct answers

  • B
  • C
  • D

Question 6 of 15 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 2 paper sat on 6 Aug 2023, in the May 2023 term (IIT M DEGREE AN3 EXAM QPE3 06 Aug 2023). It carries 5 marks.

More questions from this paper

  1. Q1Suppose that a neural network has millions of parameters (weights and biases). A team decides to use an optimization al…
  2. Q2Suppose a data set has N samples and each sample has two features f_1 \in {0, 1} and f_2 \in {0, 1}. Assume that f_1 is…
  3. Q3Figure question
  4. Q4Figure question
  5. Q5Figure question
  6. Q7Which of the following activation function(s) is (are) prone to vanishing gradient problem?
  7. Q8An input image of dimension 35 × 35 × 3 is to be convolved with 20 filters (kernels) of spatial dimension 3 × 3. In all…
  8. Q9An input image of dimension 35 × 35 × 3 is to be convolved with 20 filters (kernels) of spatial dimension 3 × 3. In all…
  9. Q10An input image of dimension 35 × 35 × 3 is to be convolved with 20 filters (kernels) of spatial dimension 3 × 3. In all…
  10. Q11The input matrix X and the kernels (K, F) are given below. The bias value for both kernels is initialized at 0.5 X = \b…
  11. Q12The input matrix X and the kernels (K, F) are given below. The bias value for both kernels is initialized at 0.5 X = \b…
  12. Q13The input matrix X and the kernels (K, F) are given below. The bias value for both kernels is initialized at 0.5 X = \b…
  13. Q14The input matrix X and the kernels (K, F) are given below. The bias value for both kernels is initialized at 0.5 X = \b…
  14. Q15The input matrix X and the kernels (K, F) are given below. The bias value for both kernels is initialized at 0.5 X = \b…