I have a feature in a model I am working on which has many unique values, DSS autoML solution initially toggled the feature off for this reason, but I am keen to see if it it could be a useful feature, as from a business perspective it's content is interesting.
What I would like to do is categorise only the most common values in the list, I looked in Feature Handling and came across the clipping options. My questions are:
Thanks for your help,
As a followup question to the above, I tried some experiments with the settings and got very different results.
For example when using the following settings:
I would expect here to only end up with 5 categories, but when I view a partial dependence plot in the model results I see:
Why am I seeing many more than 5 categories here?
I also tested the cumulative proportions setting, to see what this showed in the results:
in the partial dependence plot I again see more categories than I was expecting, but the results are also very different:
In this example we see "Jackets" scored negatively with the first settings, but it is positive here.
How can making such an apparently small change have such an impact of the results?