The goal of a machine learning regression problem is to predict a single numeric value. For example, you might want to predict the annual income of a person based on their sex (male or female), age, ...

In machine learning, typically non-linear regression techniques are used. Examples of nonlinear regression algorithms include gradient descent, Gauss-Newton, and the Levenberg-Marquardt methods.

The Data Science Lab Decision Tree Regression from Scratch Using C# Dr. James McCaffrey of Microsoft Research says the technique is easy to tune, works well with small datasets and produces highly ...