Join us on August 26th to develop an interactive Credit Scoring web application and deploy it on a Kubernetes cluster Learn more

pickle problem in custom python model

Level 1
pickle problem in custom python model
I try to use a custom python model for predicting and I started by using the MajorityClassifier from http://scikit-learn.org/stable/developers/contributing.html#rolling-your-own-estimator

I get the following error when training this model: Can't pickle

Is there a way around this?
0 Kudos
1 Reply
Dataiker
Dataiker
Hi,

Unfortunately, no workaround is possible "as-is". The pickle concept requires that the class be defined in a top level namespace, which is not the case here in a block of code which is evaluated dynamically.

The solution is to put your custom class in a separate file, and put that file in the DATA_DIR/lib/python folder of DSS. This folder is automatically added to the Python path. The code of your custom model then becomes only the instantiation of this class, which does not cause any issue.
Labels (2)