Impact Encoding, method and cross validation.

ds_stat
Level 1
Impact Encoding, method and cross validation.

Impact Encoding is offered as an alternative to one-hot-encoding. Nevertheless, i was not able to find clear documentation on two things:

1) What method is used. Simple averages/probabilities or is some kind of shrinkage used to prevent overfitting.

2) Does this happen within the cross validation loop (i.e., new encoding for each fold) or on the whole train data set before the cross-validation iteration starts? This question is also valid for the imputation methods.

 

Thanks,


Operating system used: Linux

 

0 Replies

Labels

?
Labels (1)
A banner prompting to get Dataiku