Quiz Space

Reinforcement Learning · End Term · 10 May 2026 · January 2026 term · Set S2

Reinforcement Learning End Term 10 May 2026 — Question 6

Question 6

+1 markOne or more correct options

Which of the following statements about DDPG are correct?

Select all that apply.

  1. A

    DDPG maintains four networks: actor, critic, target actor, and target critic

  2. B

    The critic is trained by minimising the Bellman error using off-policy data sampled from the replay buffer

  3. C

    DDPG is directly applicable to discrete action spaces without modification

  4. D

    The actor is updated by ascending the gradient of the critic's Q-value with respect to actor parameters

Show answer

Correct answers

  • A

    DDPG maintains four networks: actor, critic, target actor, and target critic

  • B

    The critic is trained by minimising the Bellman error using off-policy data sampled from the replay buffer

  • D

    The actor is updated by ascending the gradient of the critic's Q-value with respect to actor parameters

Question 6 of 21 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 10 May 2026, in the January 2026 term (Reinforcement Learning 10 May 26 (Session 2)). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2In DDPG, exploration is typically achieved by:
  3. Q3Figure question
  4. Q4Figure question
  5. Q5[Bonus] TRPO uses a backtracking line search after computing the natural gradient direction. What is the primary purpos…
  6. Q7Which of the following are not valid conditions required for the DPG theorem to hold?
  7. Q8Which of the following statements are correct? Select all that apply.
  8. Q9Figure question
  9. Q10Figure question
  10. Q11Figure question
  11. Q12Aditi's unstable DDPG implementation is likely to suffer from which of the following problems? Select all that apply.
  12. Q13Figure question
  13. Q14Which of the following statements about the eligibility vector for a Bernoulli-logistic unit are correct? Select all th…
  14. Q15Figure question
  15. Q16Why does the REINFORCE gradient estimator exhibit high variance, particularly in long-horizon robotic tasks?
  16. Q17Figure question
  17. Q18Figure question
  18. Q19Which of the following is a key advantage of Intra-Option Q-Learning over SMDP Q-Learning?
  19. Q20Figure question
  20. Q21Figure question