Quiz Space

Reinforcement Learning · Quiz 2 · 16 Mar 2025 · January 2025 term

Question 20: What is the value of d (i.e. the length of the discretiz…

Question 20

+2 marksNumerical answer

Based on the above data, answer the given subquestions.

What is the value of d (i.e. the length of the discretized state vector)?

Show answer

Correct answer: 29

See the whole paperTake it as a mock test

Question 20 of 22 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) Quiz 2 paper sat on 16 Mar 2025, in the January 2025 term (IIT M DEGREE AN EXAM QDB2 16 Mar 2025). It carries 2 marks.

More questions from this paper

  1. Q1For on policy SARSA update rule for Q(s, a), s, a, s′, a′ are needed. When is a′ computed/sampled?
  2. Q2Figure question
  3. Q3Figure question
  4. Q4What is a key advantage of using n-step TD prediction over one-step TD prediction?
  5. Q5Consider a reinforcement learning agent navigating a complex environment with sparse rewards. Which of the following st…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8What is the estimate of V (B) returned by first-visit MC?
  9. Q9What is the estimate of V (A) returned by first-visit MC?
  10. Q10What is the estimate of V (B) returned by batch TD(0)?
  11. Q11What is the estimate of V (A) returned by batch TD(0)?
  12. Q12V (s) is a linear function approximator.
  13. Q13Based on the above data, answer the given subquestions.
  14. Q14Based on the above data, answer the given subquestions.
  15. Q15Based on the above data, answer the given subquestions.
  16. Q16Based on the above data, answer the given subquestions.
  17. Q17Based on the above data, answer the given subquestions.
  18. Q18Based on the above data, answer the given subquestions.
  19. Q19Based on the above data, answer the given subquestions.
  20. Q21Based on the above data, answer the given subquestions.
  21. Q22Based on the above data, answer the given subquestions.