We now look at how information gain can be used in practice in an algorithm to construct decision trees. The ID3 algorithm; The calculation for information gain is the most difficult part of this ...

But there is also some empirical work comparing various algorithms across many datasets and drawing some conclusions, what types of problems tend to do better with trees vs logistic regression.