Gradient boosting machine (GBM) is one of the most significant advances in machine learning and data science that has enabled us as practitioners to use ensembles of models to best many domain-specific problems. While this tool is widely available in python packages like scikit-learn and xgboost, as a data scientist, we should always look into the theory and mathematics of the model instead of using it as a black box. In this blog, we will dive into the following areas:
- Different backing concepts of GBM
- Step-by-step illustrated to recreate GBM
- Pro’s and Con’s
1. Weak learners and ensemble learning
Weak learners and ensemble learning are the two key concepts that make gradient boosting work. A weak learner is a model that is only slightly better than random guessing. Combined with many other weak learners, they can form a robust ensemble model to make accurate predictions.
Too wordy, too complicated
Okay, imagine we are…
Understanding Gradient Boosting: A Data Scientist’s Guide | by Louis …
Louis Chan
2023-02-07 14:39:59
Towards Data Science – Medium
https://areyoupop.com/wp-content/uploads/Understanding-Gradient-Boosting-A-Data-Scientists-Guide-by-Louis.jpeg[rule_{ruleNumber}]
[rule_{ruleNumber}_plain] , ,
https://towardsdatascience.com/understanding-gradient-boosting-a-data-scientists-guide-f5e0e013f441?source=rss—-7f60cf5620c9—4
https://towardsdatascience.com/understanding-gradient-boosting-a-data-scientists-guide-f5e0e013f441?gi=14186cdeac6c&source=rss—-7f60cf5620c9—4
towardsdatascience.com
https%3A%2F%2Ftowardsdatascience.com%2Funderstanding-gradient-boosting-a-data-scientists-guide-f5e0e013f441%3Fsource%3Drss—-7f60cf5620c9—4
artificial-intelligence,machine-learning,data-science
#Understanding #Gradient #Boosting #Data #Scientists #Guide #Louis