Quiz Space

Reinforcement Learning · End Term · 10 May 2026 · January 2026 term · Set 1

Question 3: DDPG uses an experience replay buffer. What is the direct…

Question 3

+1 markOne correct option

DDPG uses an experience replay buffer. What is the direct consequence of using an experience replay buffer

  1. A

    The policy gradient estimate becomes unbiased

  2. B

    The algorithm becomes on-policy

  3. C

    Temporal correlations between consecutive samples are broken

  4. D

    The critic no longer requires a target network

Show answer

Correct answer

  • C

    Temporal correlations between consecutive samples are broken

See the whole paperTake it as a mock test

Question 3 of 20 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 10 May 2026, in the January 2026 term (Reinforcement Learning 10 May 26 (Session 2)). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q4Compared to the policy gradient, the DPG theorem requires integration over:
  4. Q5Figure question
  5. Q6Which are known limitations or failure modes of DDPG?
  6. Q7Figure question
  7. Q8Recall standard control algorithms in RL, like Q-Learning, SARSA, Expected SARSA, etc., involve a maximisation step in …
  8. Q9Figure question
  9. Q10Round your final answer to 2 decimal places.
  10. Q11Why is DPG generally more sample-efficient than SPG in high-dimensional continuous action spaces?
  11. Q12Ganesh’s on-policy DPG implementation is likely to suffer from which of the following problems? Select all that apply.
  12. Q13Figure question
  13. Q14Figure question
  14. Q15The REINFORCE gradient estimator is: Why does REINFORCE exhibit high gradient variance, particularly in long-horizon ta…
  15. Q16The REINFORCE gradient estimator is:
  16. Q17The REINFORCE gradient estimator is:
  17. Q18What is the key advantage of Intra-Option Q-Learning (Algorithm B) over SMDP Q-Learning (Algorithm A)?
  18. Q19Figure question
  19. Q20Figure question