uiz Space

May 2024 term · Reinforcement Learning · BSDA5007

Reinforcement Learning Quiz 1: 7 July 2024 (May 2024 term)

The IIT Madras BS Reinforcement Learning (Reinforcement Learning) Quiz 1 paper sat on 7 Jul 2024, in the May 2024 term: 17 questions for 40 marks in 120 minutes. Every question is below with its answer. Take it as a timed mock test to be marked, or read it through first.

Questions
17
Marks
40
Duration
120 min
Numerical
13
MCQ
3
MSQ
1
Take as mock testPractise with answers

Updated

Official paper: IIT M DEGREE AN EXAM QDB2 7 July 2024 · No negative marking.

Question 1

+2 marksNumerical answer

Based on the above data, answer the given subquestions.

Show answer

Correct answer: 0.1 (accepted within ±0.005)

Question 1 on its own page

Question 2

+2 marksNumerical answer

Based on the above data, answer the given subquestions.

Show answer

Correct answer: 0.8 (accepted within ±0.005)

Question 2 on its own page

Question 3

+2 marksOne correct option

Based on the above data, answer the given subquestions.

  1. A

    Arm A1 is the optimal arm.

  2. B

    Arm A2 is the optimal arm.

  3. C

    Arm A3 is the optimal arm.

  4. D

    An optimal arm can not be determined.

  5. E

    There is a tie for the optimal arm.

Show answer

Correct answer

  • C

    Arm A3 is the optimal arm.

Question 3 on its own page

Question 4

+2 marksOne correct option

Based on the above data, answer the given subquestions.

  1. A

    Arm A1 has to provide a reward of 4 or more.

  2. B

    Arm A2 has to provide a reward strictly more than 6.

  3. C

    Arm A3 has to provide a reward strictly less than 0.

  4. D

    It can not be determined.

  5. E

    None of these.

Show answer

Correct answer

  • B

    Arm A2 has to provide a reward strictly more than 6.

Question 4 on its own page

Question 5

+2 marksNumerical answer
Show answer

Correct answer: 3.125 (accepted within ±0.005)

Question 5 on its own page

Question 6

+2 marksNumerical answer
Show answer

Correct answer: 3.25 (accepted within ±0.005)

Question 6 on its own page

Question 7

+2 marksNumerical answer
Show answer

Correct answer: 1.4 (accepted within ±0.005)

Question 7 on its own page

Question 8

+3 marksNumerical answer
Show answer

Correct answer: 0.665 (accepted within ±0.005)

Question 8 on its own page

Question 9

+4 marksNumerical answer
Show answer

Correct answer: 2.825 (accepted within ±0.005)

Question 9 on its own page

Question 10

+2 marksOne correct option

Which of the following is the correct Bellman equation for stochastic transitions, stochastic policy and stochastic rewards? The symbols have the usual meaning.

  1. A
  2. B
  3. C
  4. D
  5. E
  6. F
Show answer

Correct answer

  • B
Question 10 on its own page

Question 11

+2 marksNumerical answer

Based on the above data, answer the given subquestions.

Show answer

Correct answer: -4

Question 11 on its own page

Question 12

+2 marksNumerical answer

Based on the above data, answer the given subquestions.

Show answer

Correct answer: -7

Question 12 on its own page

Question 13

+3 marksOne or more correct options

Based on the above data, answer the given subquestions.

Select all that apply.

  1. A

    1 and 2.

  2. B

    1 and 3.

  3. C

    2 and 3.

  4. D

    2 and 5.

  5. E

    13 and 9

  6. F

    4 and 8.

  7. G

    None of these

Show answer

Correct answers

  • D

    2 and 5.

  • E

    13 and 9

  • F

    4 and 8.

Question 13 on its own page

Question 14

+2 marksNumerical answer
Show answer

Correct answer: 10

Question 14 on its own page

Question 15

+2 marksNumerical answer
Show answer

Correct answer: 2

Question 15 on its own page

Question 16

+3 marksNumerical answer
Show answer

Correct answer: 16.08 (accepted within ±0.05)

Question 16 on its own page

Question 17

+3 marksNumerical answer
Show answer

Correct answer: 12.24 (accepted within ±0.01)

Question 17 on its own page