Quiz Space

Reinforcement Learning · End Term · 13 Apr 2025 · January 2025 term · Set 1-6

Question 4: In which of the following scenarios is Expected SARSA a g…

Question 4

+3 marksOne correct option

In which of the following scenarios is Expected SARSA a good fit?

  1. A

    When the environment has a high degree of stochasticity, makingbootstrapping unstable in value-based methods

  2. B

    When function approximation is necessary due to large state spaces, requiringdeep networks for learning representations

  3. C

    When learning needs to prioritize separating state value and advantagefunctions for better decision-making

  4. D

    When experience replay is essential for stable learning and sample efficiency

Show answer

Correct answer

  • A

    When the environment has a high degree of stochasticity, makingbootstrapping unstable in value-based methods

See the whole paperTake it as a mock test

Question 4 of 16 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M IMPROVEMENT FN EXAM QIM2 13 Apr). It carries 3 marks.

This question was also asked in

More questions from this paper

  1. Q1Consider the following assertion reason pair and select the correct option:\ Assertion: Reinforcement learning is a typ…
  2. Q2Consider a reinforcement learning agent navigating a grid world environment. The agent receives rewards of +1 for reach…
  3. Q3In Q-learning, how does maximization bias affect the performance of the algorithm in complex environments?
  4. Q5Which of the following methods are a form of Generalized Policy Iteration?
  5. Q6In the context of actor-critic methods, what is the effect of replacing the return Gt with the TD target?
  6. Q7Figure question
  7. Q8Figure question
  8. Q9Based on the above data, answer the given subquestions.
  9. Q10Based on the above data, answer the given subquestions.
  10. Q11Based on the above data, answer the given subquestions.
  11. Q12Based on the above data, answer the given subquestions.
  12. Q13Based on the above data, answer the given subquestions.
  13. Q14Which of the routes illustrated on the grid is taken when the Recursively Optimal policy is executed?
  14. Q15Which of the routes illustrated on the grid is taken when the Flat Optimal policy is executed?
  15. Q16Calculate the number of time-steps taken to finish the episode when the hierarchically optimal policy is executed.