Trouble Training new Models in an existing Project
![josurriola](https://us.v-cdn.net/6038231/uploads/Dataiku/nAvatar7.png)
josurriola
Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 5 ✭
Hey there, so I am having trouble training new models on an existing project, if I either update an existing recipe or deploy the newly trained model in a new visual tool in the flow whenever I try to score a dataset,
I am getting the following error:
Error in python process: <class 'dataiku.base.dku_pickle.PickleLoadException'>: Failed to load model from file /home/dataiku/cache/saved_models/EXPIRED_COUPONS/KsqBonL3/versions/initial/clf.pkl
Does anyone know what this could be or how to fix it? (EXPIRED_COUPONS is the project name)
18:33:24] [INFO] [dku.utils] - *************** Recipe code failed ************** [18:33:24] [INFO] [dku.utils] - Begin Python stack [18:33:24] [INFO] [dku.utils] - Traceback (most recent call last): [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/utils/load_model.py", line 12, in load_model_from_file [18:33:24] [INFO] [dku.utils] - return dku_pickle.load(clf_file) [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/base/dku_pickle.py", line 51, in load [18:33:24] [INFO] [dku.utils] - return SklearnUnpickler(pkl_file).load() [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/base/dku_pickle.py", line 147, in load [18:33:24] [INFO] [dku.utils] - return super(SklearnUnpickler, self).load() [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/utils/skcompat/_calibrated_classifier.py", line 10, in __setstate__ [18:33:24] [INFO] [dku.utils] - self.base_estimator = d['base_estimator'] [18:33:24] [INFO] [dku.utils] - KeyError: 'base_estimator' [18:33:24] [INFO] [dku.utils] - During handling of the above exception, another exception occurred: [18:33:24] [INFO] [dku.utils] - Traceback (most recent call last): [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/container/exec_eval_recipe.py", line 40, in <module> [18:33:24] [INFO] [dku.utils] - runner.run() [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/evaluation/base.py", line 134, in run [18:33:24] [INFO] [dku.utils] - self._fetch_input_dataset_and_model_params() [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/evaluation/reg_evaluation_recipe.py", line 84, in _fetch_input_dataset_and_model_params [18:33:24] [INFO] [dku.utils] - self.partition_dispatch, self.partitions = load_model_partitions(self.model_folder_context, self.core_params, [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/prediction/reg_scoring_recipe.py", line 102, in load_model_partitions [18:33:24] [INFO] [dku.utils] - partitions = {"NP": load_model(model_folder_context, core_params, for_eval=for_eval)} [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/prediction/reg_scoring_recipe.py", line 71, in load_model [18:33:24] [INFO] [dku.utils] - clf = load_model_from_file(f) [18:33:24] [INFO] [dku.utils] - File "/opt/dataiku/python/dataiku/doctor/utils/load_model.py", line 26, in load_model_from_file [18:33:24] [INFO] [dku.utils] - raise(PickleLoadException(u"Failed to load model from file {}".format(clf_file.name))) [18:33:24] [INFO] [dku.utils] - dataiku.base.dku_pickle.PickleLoadException: Failed to load model from file /home/dataiku/cache/saved_models/EXPIRED_COUPONS/KsqBonL3/versions/initial/clf.pkl
Tagged:
Answers
-
Hello
If that's a possibility for you, training and deploying using a code environment with scikit-learn >= 1.1 should solve the problem.
Also, this problem should be fixed in the next version of DSS when it's released.
Best regards,
Nicolas -
Hello,
DSS 12.5.0 has been released which should fix your problemBest regards,
Nicolas -
josurriola Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 5 ✭
Hey there, thanks!