Quiz Space

Reinforcement Learning · End Term · 10 May 2026 · January 2026 term · Set 1

Question 8: Recall standard control algorithms in RL, like Q-Learning…

Question 8

+3 marksOne or more correct options

Recall standard control algorithms in RL, like Q-Learning, SARSA, Expected SARSA, etc., involve a maximisation step in constructing their target policies.
For example: In Q-Learning, the target is:

Which of the following statements are correct? Select all that apply.

Select all that apply.

  1. A

    (A figure from the original paper is missing from the source site.)

  2. B

    (A figure from the original paper is missing from the source site.)

  3. C
  4. D

    (A figure from the original paper is missing from the source site.)

  5. E
  6. F
Show answer

Correct answers

  • B

    (A figure from the original paper is missing from the source site.)

  • C
  • E
  • F
See the whole paperTake it as a mock test

Question 8 of 20 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 10 May 2026, in the January 2026 term (Reinforcement Learning 10 May 26 (Session 2)). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3DDPG uses an experience replay buffer. What is the direct consequence of using an experience replay buffer
  4. Q4Compared to the policy gradient, the DPG theorem requires integration over:
  5. Q5Figure question
  6. Q6Which are known limitations or failure modes of DDPG?
  7. Q7Figure question
  8. Q9Figure question
  9. Q10Round your final answer to 2 decimal places.
  10. Q11Why is DPG generally more sample-efficient than SPG in high-dimensional continuous action spaces?
  11. Q12Ganesh’s on-policy DPG implementation is likely to suffer from which of the following problems? Select all that apply.
  12. Q13Figure question
  13. Q14Figure question
  14. Q15The REINFORCE gradient estimator is: Why does REINFORCE exhibit high gradient variance, particularly in long-horizon ta…
  15. Q16The REINFORCE gradient estimator is:
  16. Q17The REINFORCE gradient estimator is:
  17. Q18What is the key advantage of Intra-Option Q-Learning (Algorithm B) over SMDP Q-Learning (Algorithm A)?
  18. Q19Figure question
  19. Q20Figure question