How to balance classification using DecisionTreeClassifier?

python machine-learning scikit-learn decision-tree
RoyaumeIX picture RoyaumeIX · May 30, 2016 · Viewed 12.5k times · Source

I have a data set where the classes are unbalanced. The classes are either 0, 1 or 2.

How can I calculate the prediction error for each class and then re-balance weights accordingly in scikit-learn?

Answer

lejlot picture lejlot · May 30, 2016

If you want to fully balance (treat each class as equally important) you can simply pass class_weight='balanced', as it is stated in the docs:

The “balanced” mode uses the values of y to automatically adjust weights inversely proportional to class frequencies in the input data as n_samples / (n_classes * np.bincount(y))

Related questions

How to extract the decision rules from scikit-learn decision-tree?

Can I extract the underlying decision-rules (or 'decision paths') from a trained tree in a decision tree as a textual list? Something like: if A>0.4 then if B<0.2 then if C>0.8 then class='X' Thanks for your …

Read More
How do I solve overfitting in random forest of Python sklearn?

I am using RandomForestClassifier implemented in python sklearn package to build a binary classification model. The below is the results of cross validations: Fold 1 : Train: 164 Test: 40 Train Accuracy: 0.914634146341 Test Accuracy: 0.55 Fold 2 : Train: 163 Test: 41 Train Accuracy: 0.871165644172 Test Accuracy: 0.707317073171 Fold 3 : Train: 163 Test: 41 …

Read More
confused about random_state in decision tree of scikit learn

Confused about random_state parameter, not sure why decision tree training needs some randomness. My thoughts, (1) is it related to random forest? (2) is it related to split training testing data set? If so, why not use training testing split method …

Read More