Question 9
Suppose you face a 2-armed bandit task where, at each time step, the true action values are either (10, 20) with probability 0.7 (case A) or (90, 80) with probability 0.3 (case B).
Based on the above data, answer the given subquestions.
If, at each time step, you are told whether you face case A or case B (but not the true action values), what is the best expected reward per step you can achieve,and what strategy should you follow?
Pick Action 2 in case A, Action 1 in case B; expected reward is 41.
Always pick Action 2; expected reward is 38.
Always pick Action 1; expected reward is 34.
The expected reward stated in all the given options is incorrect.