2. What is
Classificati
on?
Classification is a process of dividing the data set into different
categories or groups by adding “label”.
Note: “It adds the data point to a particular labelled group on
the basis of some condition”
Types of Classification
o Decision tree
o Random forest
o Naïve bias
o KNN
3. What is
Decision
Tree?
A decision tree is a non-parametric supervised learning
algorithm utilized for classification and regression tasks.
It has a hierarchical, tree structure consisting of a root
node, branches, internal nodes and leaf nodes.
4. 1.Step 1: Determine the Root of the Tree
2.Step 2: Calculate Entropy for The Classes
3.Step 3: Calculate Entropy After Split for Each
Attribute
4.Step 4: Calculate Information Gain for each split
5.Step 5: Perform the Split
6.Step 6: Perform Further Splits
7.Step 7: Complete the Decision Tree
Steps included in the decision tree of classification