In this paper, we compare four state-of-the-art gradient boosting algorithms viz. XGBoost, CatBoost, LightGBM and SnapBoost. All these algorithms are a form of Gradient Boosting Decision Trees(GBDTs).