However, decision tree regression is extremely sensitive to changes in the training data, and it is susceptible to model overfitting ... but you should be able to refactor the code to a different ...

What are the advantages of logistic regression over decision trees ... if the AUC of the best model is below 0.8, logistic very clearly outperformed tree induction. You have have low signal ...