Quiz Space

Reinforcement Learning · Quiz 1 · 26 Oct 2025 · September 2025 term

Question 8: If you cannot observe which case you face, what is the be…

Question 8

+1 markOne correct option

Suppose you face a 2-armed bandit task where, at each time step, the true action values are either (10, 20) with probability 0.7 (case A) or (90, 80) with probability 0.3 (case B).
Based on the above data, answer the given subquestions.

If you cannot observe which case you face, what is the best expected reward per step you can achieve, and what strategy should you follow?

  1. A

    Randomly choose between Action 1 and Action 2; expected reward is 3.

  2. B

    Choose Action 1 always; expected reward is 34.

  3. C

    Choose Action 2 always; expected reward is 38.

  4. D

    Alternate between Action 1 and Action 2; expected reward is 40.

Show answer

Correct answer

  • C

    Choose Action 2 always; expected reward is 38.

See the whole paperTake it as a mock test

Question 8 of 16 in the IIT Madras BS Reinforcement Learning (Reinforcement Learning) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 1 mark.

More questions from this paper

  1. Q1Figure question
  2. Q2Consider following assertion reason pair:\ Assertion:\ In the UCB algorithm for multi-armed bandits, replacing the uppe…
  3. Q3Figure question
  4. Q4Figure question
  5. Q5Which of the following statements correctly describes the differences in computational complexity and convergence behav…
  6. Q6Figure question
  7. Q7Figure question
  8. Q9If, at each time step, you are told whether you face case A or case B (but not the true action values), what is the bes…
  9. Q10Which of the following best explains why a contextual bandit approach is preferred over a standard multi-armed bandit i…
  10. Q11Based on the above data, answer the given subquestions.
  11. Q12What is the main optimality goal of a contextual bandit algorithm over many rounds?
  12. Q13What is the total reward if the robot collects both treasures and then exits,taking the shortest possible path and neve…
  13. Q14Based on the above data, answer the given subquestions.
  14. Q15Consider a pole-balancing task where the goal is to apply forces to a cart moving along a track to keep a hinged pole f…
  15. Q16Consider a pole-balancing task where the goal is to apply forces to a cart moving along a track to keep a hinged pole f…