Quiz Space

Reinforcement Learning · Quiz 1 · 26 Oct 2025 · September 2025 term

Question 9: If, at each time step, you are told whether you face case…

Question 9

+1 markOne correct option

Suppose you face a 2-armed bandit task where, at each time step, the true action values are either (10, 20) with probability 0.7 (case A) or (90, 80) with probability 0.3 (case B).
Based on the above data, answer the given subquestions.

If, at each time step, you are told whether you face case A or case B (but not the true action values), what is the best expected reward per step you can achieve,and what strategy should you follow?

  1. A

    Pick Action 2 in case A, Action 1 in case B; expected reward is 41.

  2. B

    Always pick Action 2; expected reward is 38.

  3. C

    Always pick Action 1; expected reward is 34.

  4. D

    The expected reward stated in all the given options is incorrect.

Show answer

Correct answer

  • A

    Pick Action 2 in case A, Action 1 in case B; expected reward is 41.

Question 9 of 16 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2Consider following assertion reason pair:\ Assertion:\ In the UCB algorithm for multi-armed bandits, replacing the uppe…
  3. Q3Figure question
  4. Q4Figure question
  5. Q5Which of the following statements correctly describes the differences in computational complexity and convergence behav…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8If you cannot observe which case you face, what is the best expected reward per step you can achieve, and what strategy…
  9. Q10Which of the following best explains why a contextual bandit approach is preferred over a standard multi-armed bandit i…
  10. Q11Based on the above data, answer the given subquestions.
  11. Q12What is the main optimality goal of a contextual bandit algorithm over many rounds?
  12. Q13What is the total reward if the robot collects both treasures and then exits,taking the shortest possible path and neve…
  13. Q14Based on the above data, answer the given subquestions.
  14. Q15Consider a pole-balancing task where the goal is to apply forces to a cart moving along a track to keep a hinged pole f…
  15. Q16Consider a pole-balancing task where the goal is to apply forces to a cart moving along a track to keep a hinged pole f…