Consider the following feature (x) along with its label (y):
| x | y |
|---|
| 1 | 1 |
| −1 | 1 |
| 2 | 1 |
| −2 | 0 |
| 3 | 0 |
| 4 | 1 |
If you are provided with the following two questions, which one should you choose for the first(top) node of the decision tree?
(a) x≤−2
(b) x≤−1
Recall: Information gain =Entropy(D)−γEntropy(DYes)−(1−γ)Entropy(DNo)
Use the following values if required:
log2(3/4)=−0.41,log2(4/5)=−0.32,log2(1/5)=−2.32,log2(1/4)=−2,log2(1/2)=−1.