Question 2
Consider following assertion reason pair:
Assertion:
In the UCB algorithm for multi-armed bandits, replacing the upper confidence bound with a lower confidence bound (and greedily selecting actions based on that lower bound)
would still promote effective exploration or lead to optimal reward maximisation.
Reason:
Even when lower confidence bounds are used instead of upper bounds, if the algorithm greedily selects arms based on these lower bounds, it would still encourage exploration and ultimately achieve optimal reward maximisation.
Both Assertion and Reason are true, and Reason is the correct explanation of Assertion.
Both Assertion and Reason are true, but Reason is NOT the correct explanation of Assertion.
Assertion is true, Reason is false
Assertion is false, Reason is false