How to pass elegantly Sklearn's GridseachCV's best parameters to another model?

Hendrik picture Hendrik · Jul 13, 2017 · Viewed 10.2k times · Source

I have found a set of best hyperparameters for my KNN estimator with Grid Search CV:

>>> knn_gridsearch_model.best_params_
{'algorithm': 'auto', 'metric': 'manhattan', 'n_neighbors': 3}

So far, so good. I want to train my final estimator with these new-found parameters. Is there a way to feed the above hyperparameter dict to it directly? I tried this:

>>> new_knn_model = KNeighborsClassifier(knn_gridsearch_model.best_params_)

but instead the hoped result new_knn_model just got the whole dict as the first parameter of the model and left the remaining ones as default:

>>> knn_model
KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',
           metric_params=None, n_jobs=1,
           n_neighbors={'n_neighbors': 3, 'metric': 'manhattan', 'algorithm': 'auto'},
           p=2, weights='uniform')

Disappointing indeed.

Answer

Miriam Farber picture Miriam Farber · Jul 13, 2017

You can do that as follows:

new_knn_model = KNeighborsClassifier()
new_knn_model.set_params(**knn_gridsearch_model.best_params_)

Or just unpack directly as @taras suggested:

new_knn_model = KNeighborsClassifier(**knn_gridsearch_model.best_params_)

By the way, after finish running the grid search, the grid search object actually keeps (by default) the best parameters, so you can use the object itself. Alternatively, you could also access the classifier with the best parameters through

gs.best_estimator_