Quiz Space

Machine Learning Techniques · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 14: If the answer to the previous question is ”Yes,” calcula…

Question 14

+4 marksNumerical answer

Consider a binary classification problem in which a decision tree is classifying data points into two classes, A and B. In a particular node of the tree, 60% of the data points belong to class A, while the remaining 40% belong to class B.
Based on the above data, answer the given subquestions.

If the answer to the previous question is ”Yes,” calculate the entropy of this node to three decimal places. If the answer to the previous question is ”No,” enter -1 as your answer.

Show answer

Correct answer: 0.975 (accepted within ±0.035)

See the whole paperTake it as a mock test

Question 14 of 15 in the IIT Madras BS Machine Learning Techniques (MLT) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DIPLOMA AN EXAM QDD2 01 Dec 2024). It carries 4 marks.

More questions from this paper

  1. Q1Kernel regression with a polynomial kernel is applied on the following dataset with two features: X = \begin{bmatrix} 1…
  2. Q2Kernel regression with a polynomial kernel is applied on the following dataset with two features: X = \begin{bmatrix} 1…
  3. Q3A binary classification dataset has 2000 data points belonging to {0,1}^2. A Naive Bayes algorithm was run on the same …
  4. Q4A binary classification dataset has 2000 data points belonging to {0,1}^2. A Naive Bayes algorithm was run on the same …
  5. Q5Figure question
  6. Q6Consider the following feature vectors in \mathbb{R}^3: x_1 = \begin{bmatrix} 1 \ 2 \ 3 \end{bmatrix}, \quad x_2 = \beg…
  7. Q7Suppose you want to use a Naive Bayes classifier to predict whether a student will pass or fail an exam based on two fe…
  8. Q8Select all true statements.
  9. Q9What is the minimum number of misclassifications that can occur in the training dataset when using this k-NN algorithm?
  10. Q10Assuming there are outliers, the decision boundary becomes smoother with decreasing value of k in a k-NN algorithm.
  11. Q11Based on the above data, answer the given subquestions.
  12. Q12Consider the Bayesian formulation of the linear regression problem, where the prior for w is assumed to be w \sim \text…
  13. Q13Do you have enough information to find the entropy of this node?
  14. Q15Figure question