Hyperparameter Tuning // Grid Search Always Picking Biggest Numbers

[emrek]

I am using Random Forest algorithm. Also, I am trying tune hyperparameters by using Grid Search. Grid Search picking biggest number hyperparameters all the time. I am sharing a pictures about my problem. Is there any reason of this problem?

[MiguelangelC]

Hi,

There is not a problem here as far as we can see.

In training the model, it was found the 'biggest numbers' provide better results. This is also mentioned in the uploaded screenshot:'Higher values generally increase the quality of the prediction'.

[Rickh008]

Have you tested against the model using validation/hold-out dataset?

A more generalized model may perform better with new data. It's unsurprising that a more advanced model performs better on training/test data.

[emrek]

Hi, yes i did.  I was thinking that biggest number always can't be best one for model. I am sharing my project flow and hyperparameter optimization for random forest model. We can clearly see line is always going up on hyperparameter optimization plot.