Quiz Space

Reinforcement Learning · End Term · 10 May 2026 · January 2026 term · Set 1

Reinforcement Learning End Term 10 May 2026 — Question 2

Question 2

+1 markOne correct option
  1. A

    To prevent the actor from updating faster than the critic

  2. B

    To stabilise training by preventing the TD target from changing too rapidly

  3. C

    To ensure the replay buffer contains on-policy data

  4. D

    To match the learning rate of the actor and critic networks

Show answer

Correct answer

  • B

    To stabilise training by preventing the TD target from changing too rapidly

See the whole paperTake it as a mock test

Question 2 of 20 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 10 May 2026, in the January 2026 term (Reinforcement Learning 10 May 26 (Session 2)). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q3DDPG uses an experience replay buffer. What is the direct consequence of using an experience replay buffer
  3. Q4Compared to the policy gradient, the DPG theorem requires integration over:
  4. Q5Figure question
  5. Q6Which are known limitations or failure modes of DDPG?
  6. Q7Figure question
  7. Q8Recall standard control algorithms in RL, like Q-Learning, SARSA, Expected SARSA, etc., involve a maximisation step in …
  8. Q9Figure question
  9. Q10Round your final answer to 2 decimal places.
  10. Q11Why is DPG generally more sample-efficient than SPG in high-dimensional continuous action spaces?
  11. Q12Ganesh’s on-policy DPG implementation is likely to suffer from which of the following problems? Select all that apply.
  12. Q13Figure question
  13. Q14Figure question
  14. Q15The REINFORCE gradient estimator is: Why does REINFORCE exhibit high gradient variance, particularly in long-horizon ta…
  15. Q16The REINFORCE gradient estimator is:
  16. Q17The REINFORCE gradient estimator is:
  17. Q18What is the key advantage of Intra-Option Q-Learning (Algorithm B) over SMDP Q-Learning (Algorithm A)?
  18. Q19Figure question
  19. Q20Figure question