Decision Trees, Random Forests, AdaBoost & XGBoost in Python

Decision Trees and Ensembling techniques in Python. How to run Bagging, Random Forest, GBM, AdaBoost & XGBoost in Python

4.35 (695 reviews)
Data & Analytics
Decision Trees, Random Forests, AdaBoost & XGBoost in Python
7 hours
Jan 2022
last update
regular price

What you will learn

Get a solid understanding of decision tree

Understand the business scenarios where decision tree is applicable

Tune a machine learning model's hyperparameters and evaluate its performance.

Use Pandas DataFrames to manipulate data and make statistical computations.

Use decision trees to make predictions

Learn the advantage and disadvantages of the different algorithms


You're looking for a complete Decision tree course that teaches you everything you need to create a Decision tree/ Random Forest/ XGBoost model in Python, right?

You've found the right Decision Trees and tree based advanced techniques course!

After completing this course you will be able to:

  • Identify the business problem which can be solved using Decision tree/ Random Forest/ XGBoost  of Machine Learning.

  • Have a clear understanding of Advanced Decision tree based algorithms such as Random Forest, Bagging, AdaBoost and XGBoost

  • Create a tree based (Decision tree, Random Forest, Bagging, AdaBoost and XGBoost) model in Python and analyze its result.

  • Confidently practice, discuss and understand Machine Learning concepts

How this course will help you?

A Verifiable Certificate of Completion is presented to all students who undertake this Machine learning advanced course.

If you are a business manager or an executive, or a student who wants to learn and apply machine learning in Real world problems of business, this course will give you a solid base for that by teaching you some of the advanced technique of machine learning, which are Decision tree, Random Forest, Bagging, AdaBoost and XGBoost.

Why should you choose this course?

This course covers all the steps that one should take while solving a business problem through Decision tree.

Most courses only focus on teaching how to run the analysis but we believe that what happens before and after running analysis is even more important i.e. before running analysis it is very important that you have the right data and do some pre-processing on it. And after running analysis, you should be able to judge how good your model is and interpret the results to actually be able to help your business.

What makes us qualified to teach you?

The course is taught by Abhishek and Pukhraj. As managers in Global Analytics Consulting firm, we have helped businesses solve their business problem using machine learning techniques and we have used our experience to include the practical aspects of data analysis in this course

We are also the creators of some of the most popular online courses - with over 150,000 enrollments and thousands of 5-star reviews like these ones:

This is very good, i love the fact the all explanation given can be understood by a layman - Joshua

Thank you Author for this wonderful course. You are the best and this course is worth any price. - Daisy

Our Promise

Teaching our students is our job and we are committed to it. If you have any questions about the course content, practice sheet or anything related to any topic, you can always post a question in the course or send us a direct message.

Download Practice files, take Quizzes, and complete Assignments

With each lecture, there are class notes attached for you to follow along. You can also take quizzes to check your understanding of concepts. Each section contains a practice assignment for you to practically implement your learning.

What is covered in this course?

This course teaches you all the steps of creating a decision tree based model, which are some of the most popular Machine Learning model, to solve business problems.

Below are the course contents of this course on Linear Regression:

  • Section 1 - Introduction to Machine Learning

    In this section we will learn - What does Machine Learning mean. What are the meanings or different terms associated with machine learning? You will see some examples so that you understand what machine learning actually is. It also contains steps involved in building a machine learning model, not just linear models, any machine learning model.

  • Section 2 - Python basic

    This section gets you started with Python.

    This section will help you set up the python and Jupyter environment on your system and it'll teach you how to perform some basic operations in Python. We will understand the importance of different libraries such as Numpy, Pandas & Seaborn.

  • Section 3 - Pre-processing and Simple Decision trees

    In this section you will learn what actions you need to take to prepare it for the analysis, these steps are very important for creating a meaningful.

    In this section, we will start with the basic theory of decision tree then we cover data pre-processing topics like  missing value imputation, variable transformation and Test-Train split. In the end we will create and plot a simple Regression decision tree.

  • Section 4 - Simple Classification Tree

    This section we will expand our knowledge of regression Decision tree to classification trees, we will also learn how to create a classification tree in Python

  • Section 5, 6 and 7 - Ensemble technique
    In this section we will start our discussion about advanced ensemble techniques for Decision trees. Ensembles techniques are used to improve the stability and accuracy of machine learning algorithms. In this course we will discuss Random Forest, Baggind, Gradient Boosting, AdaBoost and XGBoost.

By the end of this course, your confidence in creating a Decision tree model in Python will soar. You'll have a thorough understanding of how to use Decision tree  modelling to create predictive models and solve business problems.

Go ahead and click the enroll button, and I'll see you in lesson 1!


Start-Tech Academy


Below is a list of popular FAQs of students who want to start their Machine learning journey-

What is Machine Learning?

Machine Learning is a field of computer science which gives the computer the ability to learn without being explicitly programmed. It is a branch of artificial intelligence based on the idea that systems can learn from data, identify patterns and make decisions with minimal human intervention.

What are the steps I should follow to be able to build a Machine Learning model?

You can divide your learning process into 4 parts:

Statistics and Probability - Implementing Machine learning techniques require basic knowledge of Statistics and probability concepts. Second section of the course covers this part.

Understanding of Machine learning - Fourth section helps you understand the terms and concepts associated with Machine learning and gives you the steps to be followed to build a machine learning model

Programming Experience - A significant part of machine learning is programming. Python and R clearly stand out to be the leaders in the recent days. Third section will help you set up the Python environment and teach you some basic operations. In later sections there is a video on how to implement each concept taught in theory lecture in Python

Understanding of Linear Regression modelling - Having a good knowledge of Linear Regression gives you a solid understanding of how machine learning works. Even though Linear regression is the simplest technique of Machine learning, it is still the most popular one with fairly good prediction ability. Fifth and sixth section cover Linear regression topic end-to-end and with each theory lecture comes a corresponding practical lecture where we actually run each query with you.

Why use Python for data Machine Learning?

Understanding Python is one of the valuable skills needed for a career in Machine Learning.

Though it hasn’t always been, Python is the programming language of choice for data science. Here’s a brief history:

    In 2016, it overtook R on Kaggle, the premier platform for data science competitions.

    In 2017, it overtook R on KDNuggets’s annual poll of data scientists’ most used tools.

    In 2018, 66% of data scientists reported using Python daily, making it the number one tool for analytics professionals.

Machine Learning experts expect this trend to continue with increasing development in the Python ecosystem. And while your journey to learn Python programming may be just beginning, it’s nice to know that employment opportunities are abundant (and growing) as well.

What is the difference between Data Mining, Machine Learning, and Deep Learning?

Put simply, machine learning and data mining use the same algorithms and techniques as data mining, except the kinds of predictions vary. While data mining discovers previously unknown patterns and knowledge, machine learning reproduces known patterns and knowledge—and further automatically applies that information to data, decision-making, and actions.

Deep learning, on the other hand, uses advanced computing power and special types of neural networks and applies them to large amounts of data to learn, understand, and identify complicated patterns. Automatic language translation and medical diagnoses are examples of deep learning.



Welcome to the Course!
Course Resources

Setting up Python and Python Crash Course

Installing Python and Anaconda
Opening Jupyter Notebook
Introduction to Jupyter
Arithmetic operators in Python: Python Basics
Strings in Python: Python Basics
Lists, Tuples and Directories: Python Basics
Working with Numpy Library of Python
Working with Pandas Library of Python
Working with Seaborn Library of Python

Machine Learning Basics

Introduction to Machine Learning
Building a Machine Learning Model

Simple Decision trees

Basics of decision trees
Understanding a Regression Tree
The stopping criteria for controlling tree growth
The Data set for the Course
Importing Data in Python
Missing value treatment in Python
Dummy Variable creation in Python
Dependent- Independent Data split in Python
Test-Train split in Python
Creating Decision tree in Python
Evaluating model performance in Python
Plotting decision tree in Python
Pruning a tree
Pruning a tree in Python

Simple Classification Tree

Classification tree
The Data set for Classification problem
Classification tree in Python : Preprocessing
Classification tree in Python : Training
Advantages and Disadvantages of Decision Trees

Ensemble technique 1 - Bagging

Ensemble technique 1 - Bagging
Ensemble technique 1 - Bagging in Python

Ensemble technique 2 - Random Forests

Ensemble technique 2 - Random Forests
Ensemble technique 2 - Random Forests in Python
Using Grid Search in Python

Ensemble technique 3 - Boosting

Ensemble technique 3a - Boosting in Python
Ensemble technique 3b - AdaBoost in Python
Ensemble technique 3c - XGBoost in Python

Add-on 1: Preprocessing and Preparing Data before making ML model

Gathering Business Knowledge
Data Exploration
The Dataset and the Data Dictionary
Importing Data in Python
Univariate analysis and EDD
EDD in Python
Outlier Treatment
Outlier Treatment in Python
Missing Value Imputation
Missing Value Imputation in Python
Seasonality in Data
Bi-variate analysis and Variable transformation
Variable transformation and deletion in Python
Non-usable variables
Dummy variable creation: Handling qualitative data
Dummy variable creation in Python
Correlation Analysis
Correlation Analysis in Python


Bonus Lecture


June 9, 2022
A very good course. I think it would be excellent with a more detailed explanation on the topic of decision trees and ensemble models. and ensemble models. About code and explanation in python was excellent. I highly recommend it.
May 4, 2022
the speed at which the course is taught is excellent.. Description of concepts is very good and the explanation helps in immediate application i=of the concepts
April 12, 2022
Could have been more comprehensive with math behind decision tree. There was no mention of information gain which defines how a split happens.
January 4, 2022
It was very nice. I would note that you can also use the code below in lieu of dropping a category after using pd.get_dummies: df = pd.get_dummies(df,drop_first=True)
November 1, 2021
It's very good course to introduce you into ML in Python. The course is focused on practice. I'd add more theory but probably it is better as it is for majority of students :)
July 17, 2021
Awesome Course. This Course Content is up to mark according to industry requirements. One must join this course to master Decision Trees, Random Forests to take their skills to the advanced level.
July 13, 2021
The course was really well explained. I appreciated the theory as well as the practical work covered in the course!
May 26, 2021
The course is good but suffers from terrible and pathetic english. One of the instructors pronounce jupyter notebook as JUPITER notebook. Also the course is not engaging at all because of the way instructors speak. The instructors should make a script and give it to some one who can speak well. Really disappointed. Communication has completely ruined this course which otherwise could have been something great.
February 3, 2021
Not good at all. Zero Elaboration on why parameters should be chosen. Anyone can read the documentation, was expecting more.
February 1, 2021
Great course! Very simple to understand and makes the student confident for self-exploration of these topics. However, the PPTs/Theory Lectures could have been made way better & interesting. Therefore, not giving a 5* even though I would definitely recommend this course to anyone who is serious about advanced ML topics.
December 12, 2020
Instructor is not engaging. it is such an interesting topic but the instructor slow delivery is pulling the life out of it. The presentation that we are looking at, the written martial is complicated and not at all easy to understand. the presentation could have been a bit easy and more understandable and interesting. Conclusively : this course is Difficult to understand.
October 19, 2020
This is a very good course on DT and RF. As mentioned in the feedback for Linear Regression course, please consider adding more questions/tests in regular interval between the topics. Thank you for such a wonderful course.
May 12, 2020
Overall good course, only missed some related case study which uses decision trees to solve their problems
May 3, 2020
Step by step walk through of a quasi real life analysis. Very straight forward to learn how to code different tools. Some concepts are only introduced. For example it would help a slide to explain confusion matrix or how ensemble techniques get to a final score.
April 28, 2020
It was amazing and really informative course and an excellent instructor, my thanks for both of them and thank you Udemy.



Decision Trees, Random Forests, AdaBoost & XGBoost in Python - Price chart


Decision Trees, Random Forests, AdaBoost & XGBoost in Python - Ratings chart

Enrollment distribution

Decision Trees, Random Forests, AdaBoost & XGBoost in Python - Distribution chart


12/11/2019100% OFF
12/24/2019100% OFF
1/20/2020100% OFF
1/30/2020100% OFF
3/13/202067% OFF
4/13/2020100% OFF
4/21/2020100% OFF
4/28/2020100% OFF
5/2/2020100% OFF
5/15/2020100% OFF
5/27/2020100% OFF
6/9/2020100% OFF
7/4/2020100% OFF
8/12/2020100% OFF
8/30/2020100% OFF
9/19/2020100% OFF
9/29/2020100% OFF
10/10/2020100% OFF
10/27/2020100% OFF
11/17/2020100% OFF
7/23/2021100% OFF
8/22/2021100% OFF
10/23/2021100% OFF
2/8/2022100% OFF
3/3/2022100% OFF
3/31/2022100% OFF
4/11/2022100% OFF
4/30/2022100% OFF
5/7/2022100% OFF
5/18/2022100% OFF
5/31/2022100% OFF
6/30/2022100% OFF
7/8/2022100% OFF
7/17/2022100% OFF
7/30/2022100% OFF
udemy ID
course created date
course indexed date
course submited by