Quiz Space

Machine Learning Techniques · Quiz 2 · 16 Mar 2025 · January 2025 term

Question 5: Consider the following feature (x) along with its label (…

Question 5

+4 marksOne correct option

Consider the following feature (xx) along with its label (yy):

xxyy
11
−1-11
21
−2-20
30
41

If you are provided with the following two questions, which one should you choose for the first(top) node of the decision tree?

(a) x≤−2x \leq -2
(b) x≤−1x \leq -1

Recall: Information gain =Entropy(D)−γEntropy(DYes)−(1−γ)Entropy(DNo)= \text{Entropy}(D) - \gamma \text{Entropy}(D_{Yes}) - (1 - \gamma) \text{Entropy}(D_{No})

Use the following values if required:
log⁡2(3/4)=−0.41,log⁡2(4/5)=−0.32,log⁡2(1/5)=−2.32,log⁡2(1/4)=−2,log⁡2(1/2)=−1.\log_2(3/4) = -0.41, \log_2(4/5) = -0.32, \log_2(1/5) = -2.32, \log_2(1/4) = -2, \log_2(1/2) = -1.

  1. A

    (a)

  2. B

    (b)

  3. C

    Insufficient information

Show answer

Correct answer

  • A

    (a)

Question 5 of 14 in the IIT Madras BS Machine Learning Techniques (MLT) Quiz 2 paper sat on 16 Mar 2025, in the January 2025 term (IIT M DIPLOMA AN EXAM QDD2 16 Mar 2025). It carries 4 marks.

More questions from this paper

  1. Q1Below is the constrained version of the ridge regression optimization problem: \min_{w \in \mathbb{R}} \sum_{i=1}^{n} (…
  2. Q2Figure question
  3. Q3p is the proportion of points with label 1 in some node in a decision tree. Which of the following statements are true?
  4. Q4Figure question
  5. Q6Figure question
  6. Q7Figure question
  7. Q8Consider a kernel regression problem on the following dataset with two features: {(x_1, y_1), (x_2, y_2), (x_3, y_3)} w…
  8. Q9Consider a Naive Bayes problem with three features, f_1, f_2 and f_3 for a binary classification problem. We have a tot…
  9. Q10Based on the above data, answer the given subquestions.
  10. Q11Based on the above data, answer the given subquestions.
  11. Q12Consider the following 2D data points along with its labels: | x | y | |---|---| | \begin{bmatrix} 1 & 1 \end{bmatrix}^…
  12. Q13Consider the following 2D data points along with its labels: | x | y | |---|---| | \begin{bmatrix} 1 & 1 \end{bmatrix}^…
  13. Q14Consider the following 2D data points along with its labels: | x | y | |---|---| | \begin{bmatrix} 1 & 1 \end{bmatrix}^…