Quiz Space

Reinforcement Learning · End Term · 13 Apr 2025 · January 2025 term · Set 1-3

Question 1: In which of the following scenarios is Expected SARSA a g…

Question 1

+2 marksOne correct option

In which of the following scenarios is Expected SARSA a good fit?

  1. A

    When the environment has a high degree of stochasticity, makingbootstrapping unstable in value-based methods

  2. B

    When function approximation is necessary due to large state spaces, requiringdeep networks for learning representations

  3. C

    When learning needs to prioritize separating state value and advantagefunctions for better decision-making

  4. D

    When experience replay is essential for stable learning and sample efficiency

Show answer

Correct answer

  • A

    When the environment has a high degree of stochasticity, makingbootstrapping unstable in value-based methods

Question 1 of 16 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M IMPROVEMENT FN EXAM QIM2 13 Apr). It carries 2 marks.

This question was also asked in

More questions from this paper

  1. Q2Figure question
  2. Q3Choose the correct statement in context of multi armed bandits (MAB), assuming stationary and normal reward distributio…
  3. Q4Which of the following methods are a form of Generalized Policy Iteration?
  4. Q5Figure question
  5. Q6Figure question
  6. Q7Figure question
  7. Q8Based on the above data, answer the given subquestions.
  8. Q9Based on the above data, answer the given subquestions.
  9. Q10Based on the above data, answer the given subquestions.
  10. Q11Based on the above data, answer the given subquestions.
  11. Q12Which of the routes illustrated on the grid is taken when the Hierarchically Optimal policy is executed?
  12. Q13Which of the routes illustrated on the grid is taken when the Flat Optimal policy is executed?
  13. Q14Calculate the number of time-steps taken to finish the episode when the re-cursively optimal policy is executed.
  14. Q15Based on the above data, answer the given subquestions.
  15. Q16Which action would you pick, after having performed this rollout?