Error while training timeseries forecasting models
vaishnavi
Registered Posts: 40 ✭✭✭✭
I am getting the below error when I try to train the model on timeseries models (Quick prototypes) irrespective of the model (AutoArima, SeasonalTrend, SeasonalNaive, NPTS) chosen for training.
[2022/09/20-14:58:14.325] [FT-TrainWorkThread-PQgu5AHu-117103] [ERROR] [dku.analysis] T-sI0ybdA7 - Failure while training main loop java.lang.NullPointerException at com.dataiku.dip.analysis.ml.prediction.split.SortedSingleDatasetSplitGenerator.updateSplitIfNeeded_NT(SortedSingleDatasetSplitGenerator.java:187) at com.dataiku.dip.analysis.ml.prediction.split.PredictionSplitGenerator.updateSplitAndMLAssertionsMasksIfNeeded_NT(PredictionSplitGenerator.java:21) at com.dataiku.dip.analysis.ml.prediction.AbstractPythonPredictionMLTaskHandler.prepareSplits(AbstractPythonPredictionMLTaskHandler.java:39) at com.dataiku.dip.analysis.ml.PythonMLTaskHandler.train(PythonMLTaskHandler.java:71) at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.executeProcess(PredictionService.java:1534) at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.execute(PredictionService.java:1564) at com.dataiku.dip.futures.FutureThreadBase.run(FutureThreadBase.java:105) [2022/09/20-14:58:14.326] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6269] Locking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp1/m1/train_info.json [2022/09/20-14:58:14.327] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6270] Unlocking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp1/m1/train_info.json [2022/09/20-14:58:14.327] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6270] Locking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp2/m1/train_info.json [2022/09/20-14:58:14.328] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6271] Unlocking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp2/m1/train_info.json [2022/09/20-14:58:14.329] [FT-TrainWorkThread-PQgu5AHu-117103] [ERROR] [dku.analysis.prediction] T-sI0ybdA7 - Failed to train java.lang.NullPointerException at com.dataiku.dip.analysis.ml.prediction.split.SortedSingleDatasetSplitGenerator.updateSplitIfNeeded_NT(SortedSingleDatasetSplitGenerator.java:187) at com.dataiku.dip.analysis.ml.prediction.split.PredictionSplitGenerator.updateSplitAndMLAssertionsMasksIfNeeded_NT(PredictionSplitGenerator.java:21) at com.dataiku.dip.analysis.ml.prediction.AbstractPythonPredictionMLTaskHandler.prepareSplits(AbstractPythonPredictionMLTaskHandler.java:39) at com.dataiku.dip.analysis.ml.PythonMLTaskHandler.train(PythonMLTaskHandler.java:71) at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.executeProcess(PredictionService.java:1534) at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.execute(PredictionService.java:1564) at com.dataiku.dip.futures.FutureThreadBase.run(FutureThreadBase.java:105) [2022/09/20-14:58:14.332] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.trainingdetails] T-sI0ybdA7 - Publishing mltask-train-done reflected event
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker
Hi @vaishnavi
,Based on the logs shared and especially NullPointerException it's difficult to know the exact root cause.
Can you please open a support ticket with the model training logs and will investigate this further. We may need additional information based on the contents of the logs.
https://doc.dataiku.com/dss/latest/troubleshooting/obtaining-support.html
Kind Regards,
Alex