pickle problem in custom python model

RoelVanderPaal
Level 1
pickle problem in custom python model
I try to use a custom python model for predicting and I started by using the MajorityClassifier from http://scikit-learn.org/stable/developers/contributing.html#rolling-your-own-estimator

I get the following error when training this model: Can't pickle

Is there a way around this?
0 Kudos
1 Reply
Clรฉment_Stenac
Hi,

Unfortunately, no workaround is possible "as-is". The pickle concept requires that the class be defined in a top level namespace, which is not the case here in a block of code which is evaluated dynamically.

The solution is to put your custom class in a separate file, and put that file in the DATA_DIR/lib/python folder of DSS. This folder is automatically added to the Python path. The code of your custom model then becomes only the instantiation of this class, which does not cause any issue.

Labels

?
Labels (2)
A banner prompting to get Dataiku