Quiz Space

Introduction to Deep Learning and Generative AI · Quiz 2 · 23 Nov 2025 · September 2025 term

Question 23: The LSTM (Long Short-Term Memory) network uses several g…

Question 23

+2 marksOne correct option

The LSTM (Long Short-Term Memory) network uses several gates to control information flow. Here are the key equations with a placeholder [?] for a missing operator:

Gate Computations:

  1. Forget gate: ft=σ(Wf⋅[ht−1,xt]+bf)f_t = \sigma(W_f \cdot [h_{t-1}, x_t] + b_f)
  2. Input gate: it=σ(Wi⋅[ht−1,xt]+bi)i_t = \sigma(W_i \cdot [h_{t-1}, x_t] + b_i)
  3. Candidate values: c~t=tanh(Wc⋅[ht−1,xt]+bc)\tilde{c}_t = tanh(W_c \cdot [h_{t-1}, x_t] + b_c)
  4. Output gate: ot=σ(Wo⋅[ht−1,xt]+bo)o_t = \sigma(W_o \cdot [h_{t-1}, x_t] + b_o)

Memory Update Equations (with placeholder):

  1. Cell state update: ct=ft[?]ct−1+it[?]c~tc_t = f_t[?]c_{t-1} + i_t[?]\tilde{c}_t
  2. Hidden state update: ht=ot[?]tanh(ct)h_t = o_t[?]tanh(c_t)

Which operator should replace [?] in the LSTM memory update equations (5 and 6) above?

  1. A

    Matrix multiplication (·)

  2. B

    Element-wise multiplication (⊙)

  3. C

    Cross product (x)

  4. D

    Element-wise addition (+)

Show answer

Correct answer

  • B

    Element-wise multiplication (⊙)

Video solution

The video solution to this question is being recorded and will play here. Until then, the answer key is above.

See the whole paperTake it as a mock test

Question 23 of 25 in the IIT Madras BS Introduction to Deep Learning and Generative AI (Deep Learning and GenAI) Quiz 2 paper sat on 23 Nov 2025, in the September 2025 term (IIT M DIPLOMA AN EXAM QDD2 23 Nov 2025 NEW). It carries 2 marks.

More questions from this paper

  1. Q1You have a tensor x = torch.tensor([1, 2, 3, 4]). You perform And What will be the shapes of stacked_x_dim0 and stacked…
  2. Q2You have a PyTorch tensor residing on the GPU. You then attempt to convert it directly to a NumPy array using What will…
  3. Q3The Huber Loss function is introduced as a robust alternative to Mean Squared Error (MSE) and Mean Absolute Error (MAE)…
  4. Q4A deep learning model contains a stack of three consecutive 3x3 convolutional layers, each with a stride of 1and suffic…
  5. Q5Figure question
  6. Q6The Momentum optimizer helps overcome which limitation of vanilla Gradient Descent?
  7. Q7Consider the RMSProp optimizer update rule: v_t = \beta v_{t-1} + (1 - \beta)(\nabla w_t)^2 The algorithm runs for 10 i…
  8. Q8You are given two loss functions. Your task is to identify their nature using the second derivative test. Function A: A…
  9. Q9What happens if the latent space in a GAN has too few dimensions for the task complexity?
  10. Q10At Nash Equilibrium in a perfectly trained GAN, what is the expected output of the discriminator D(G(z)) for a generate…
  11. Q11A student is trying to write the Generator training loop and is confused about the order of operations. Their code is: …
  12. Q12You've been training your GAN for 100 epochs. You notice two things: The Generator loss (g_loss) is very low and stable…
  13. Q13Figure question
  14. Q14Figure question
  15. Q15Figure question
  16. Q16Consider that the following paragraph is used as the input to train a sequence language model: "this is a great sunny d…
  17. Q17Figure question
  18. Q18You are performing Beam Search with K=2 to generate a sequence. Step 1: The model predicts probabilities for the first …
  19. Q19Figure question
  20. Q20Figure question
  21. Q21Given the update rule for Adagrad \begin{aligned} v_t &= v_{t-1} + (\nabla w_t)^2 \ w_{t+1} &= w_t - \frac{\eta}{\sqrt{…
  22. Q22In an LSTM (Long Short-Term Memory) network, which pair of components correctly represents the short-term and long-term…
  23. Q24You are training an RNN-based text classification model with the following three sequences: Under which training scenar…
  24. Q25Consider the following modified implementation of an RNN. What will be the percentage reduction in the rnn parameters d…