Quiz Space

Reinforcement Learning · End Term · 10 May 2026 · January 2026 term · Set 1

Question 12: Ganesh’s on-policy DPG implementation is likely to suffe…

Question 12

+2 marksOne or more correct options

Ganesh’s on-policy DPG implementation is likely to suffer from which of the following problems? Select all that apply.

Select all that apply.

  1. A
  2. B
  3. C

    The DPG theorem technically requires an off-policy behaviour policy to ensure sufficient state coverage; on-policy data violates this

  4. D
  5. E
Show answer

Correct answers

  • A
  • C

    The DPG theorem technically requires an off-policy behaviour policy to ensure sufficient state coverage; on-policy data violates this

  • D
See the whole paperTake it as a mock test

Question 12 of 20 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 10 May 2026, in the January 2026 term (Reinforcement Learning 10 May 26 (Session 2)). It carries 2 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3DDPG uses an experience replay buffer. What is the direct consequence of using an experience replay buffer
  4. Q4Compared to the policy gradient, the DPG theorem requires integration over:
  5. Q5Figure question
  6. Q6Which are known limitations or failure modes of DDPG?
  7. Q7Figure question
  8. Q8Recall standard control algorithms in RL, like Q-Learning, SARSA, Expected SARSA, etc., involve a maximisation step in …
  9. Q9Figure question
  10. Q10Round your final answer to 2 decimal places.
  11. Q11Why is DPG generally more sample-efficient than SPG in high-dimensional continuous action spaces?
  12. Q13Figure question
  13. Q14Figure question
  14. Q15The REINFORCE gradient estimator is: Why does REINFORCE exhibit high gradient variance, particularly in long-horizon ta…
  15. Q16The REINFORCE gradient estimator is:
  16. Q17The REINFORCE gradient estimator is:
  17. Q18What is the key advantage of Intra-Option Q-Learning (Algorithm B) over SMDP Q-Learning (Algorithm A)?
  18. Q19Figure question
  19. Q20Figure question