Quiz Space

Machine Learning Techniques · End Term · 13 Sept 2026 · May 2026 term · Set S2

Question 17: Which of the following statements about entropy and info…

Question 17

+3 marksOne or more correct options

Which of the following statements about entropy and information gain in decision-tree learning are correct?

Select all that apply.

  1. A

    If a feature splits a node into perfectly pure children, its information gain at that node equals the entropy of that node.

  2. B
  3. C

    Information gain can be negative if a split increases impurity.

  4. D

    After a parent node is split into child nodes, no individual child node can have entropy greater than the parent node's entropy.

Show answer

Correct answers

  • A

    If a feature splits a node into perfectly pure children, its information gain at that node equals the entropy of that node.

  • B
See the whole paperTake it as a mock test

Question 17 of 18 in the IIT Madras BS Machine Learning Techniques (MLT) End Term paper sat on 13 Sept 2026, in the May 2026 term (Machine Learning Techniques 13 Sep 26 (Session 2)). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Figure question
  3. Q3Let
  4. Q4Figure question
  5. Q5Consider the effect of each operation below on a model's bias and variance. Which of the following statements are corre…
  6. Q6Figure question
  7. Q7Figure question
  8. Q8Figure question
  9. Q9Figure question
  10. Q10Consider one-dimensional ridge regression with no bias term. Given and
  11. Q11For the covariance matrix , compute the variance captured along the first principal component.
  12. Q12Figure question
  13. Q13Figure question
  14. Q14Consider a binary classification dataset in which the two classes are perfectly linearly separable. You are considering…
  15. Q15Figure question
  16. Q16Note: coordinates of x1 vector are intentionally not provided.
  17. Q18Which of the following statements about bagging are correct?