Quiz Space

Deep Learning · Quiz 1 · 13 Jul 2025 · May 2025 term

Question 14: Starting at (x_0, y_0), we now turn to momentum based gr…

Question 14

+6 marksNumerical answer

Based on the above data, answer the given subquestions.

Starting at (x0,y0)(x_0, y_0), we now turn to momentum based gradient descent. The momentum updates are given below. Starting with u−1=(0,0)u_{-1} = (0,0) and η=0.2\eta = 0.2, we have:

ut=βut−1+∇f(x,y)∣(xt,yt)(xt+1,yt+1)=(xt,yt)−ηut\begin{aligned} u_t &= \beta u_{t-1} + \nabla f(x, y)\Big|_{(x_t, y_t)} \\ (x_{t+1}, y_{t+1}) &= (x_t, y_t) - \eta u_t \end{aligned}

What should be the momentum parameter β\beta so that running two steps of momentum based gradient descent takes us to the global minimum? Note that the sequence of iterates will be: (x0,y0)→(x1,y1)→(x2,y2)(x_0, y_0) \to (x_1, y_1) \to (x_2, y_2), where (x2,y2)(x_2, y_2) is the global minimum of ff. Enter your answer correct to two places after the decimal.

Show answer

Correct answer: 0.9 (accepted within ±0.01)

Question 14 of 14 in the IIT Madras BS Deep Learning (Deep Learning) Quiz 1 paper sat on 13 Jul 2025, in the May 2025 term (IIT M DEGREE AN EXAM QDB2 13 July 2025). It carries 6 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Which of the following is true?
  3. Q3Figure question
  4. Q4Figure question
  5. Q5To learn the parameters of a neural network for a classification problem, mini-batch gradient descent is run on a datas…
  6. Q6Let h : {0,1}^5 \to {0,1} be a Boolean function. Consider an MP neuron with five binary inputs, all of which are excita…
  7. Q7Let h : {0,1}^5 \to {0,1} be a Boolean function. Consider an MP neuron with five binary inputs, all of which are excita…
  8. Q8Let h : {0,1}^5 \to {0,1} be a Boolean function. Consider an MP neuron with five binary inputs, all of which are excita…
  9. Q9Consider a neural network for a regression problem with one input and one output. There is one hidden layer with two si…
  10. Q10Consider a neural network for a regression problem with one input and one output. There is one hidden layer with two si…
  11. Q11Find the number of weights in the network.
  12. Q12If all the weights in the network have the same value, find the cross entropy loss for an arbitrary data-point. If this…
  13. Q13Starting at (x_0, y_0), run two steps of gradient descent with learning rate \eta = 0.2 to obtain (x_2, y_2). If (x_2, …