Error while training timeseries forecasting models

vaishnavi

I am getting the below error when I try to train the model on timeseries models (Quick prototypes) irrespective of the model (AutoArima, SeasonalTrend, SeasonalNaive, NPTS) chosen for training.

[2022/09/20-14:58:14.325] [FT-TrainWorkThread-PQgu5AHu-117103] [ERROR] [dku.analysis] T-sI0ybdA7 - Failure while training main loop
java.lang.NullPointerException
    at com.dataiku.dip.analysis.ml.prediction.split.SortedSingleDatasetSplitGenerator.updateSplitIfNeeded_NT(SortedSingleDatasetSplitGenerator.java:187)
    at com.dataiku.dip.analysis.ml.prediction.split.PredictionSplitGenerator.updateSplitAndMLAssertionsMasksIfNeeded_NT(PredictionSplitGenerator.java:21)
    at com.dataiku.dip.analysis.ml.prediction.AbstractPythonPredictionMLTaskHandler.prepareSplits(AbstractPythonPredictionMLTaskHandler.java:39)
    at com.dataiku.dip.analysis.ml.PythonMLTaskHandler.train(PythonMLTaskHandler.java:71)
    at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.executeProcess(PredictionService.java:1534)
    at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.execute(PredictionService.java:1564)
    at com.dataiku.dip.futures.FutureThreadBase.run(FutureThreadBase.java:105)
[2022/09/20-14:58:14.326] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6269] Locking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp1/m1/train_info.json
[2022/09/20-14:58:14.327] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6270] Unlocking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp1/m1/train_info.json
[2022/09/20-14:58:14.327] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6270] Locking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp2/m1/train_info.json
[2022/09/20-14:58:14.328] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.ml] T-sI0ybdA7 - [ct: 6271] Unlocking model train info file /usr/src/app/dataiku-install/analysis-data/LCP_PROJECTION_MODELPROPHET/Y8GNnF7b/sI0ybdA7/sessions/s2/pp2/m1/train_info.json
[2022/09/20-14:58:14.329] [FT-TrainWorkThread-PQgu5AHu-117103] [ERROR] [dku.analysis.prediction] T-sI0ybdA7 - Failed to train
java.lang.NullPointerException
    at com.dataiku.dip.analysis.ml.prediction.split.SortedSingleDatasetSplitGenerator.updateSplitIfNeeded_NT(SortedSingleDatasetSplitGenerator.java:187)
    at com.dataiku.dip.analysis.ml.prediction.split.PredictionSplitGenerator.updateSplitAndMLAssertionsMasksIfNeeded_NT(PredictionSplitGenerator.java:21)
    at com.dataiku.dip.analysis.ml.prediction.AbstractPythonPredictionMLTaskHandler.prepareSplits(AbstractPythonPredictionMLTaskHandler.java:39)
    at com.dataiku.dip.analysis.ml.PythonMLTaskHandler.train(PythonMLTaskHandler.java:71)
    at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.executeProcess(PredictionService.java:1534)
    at com.dataiku.dip.analysis.coreservices.PredictionService$TrainWorkThread.execute(PredictionService.java:1564)
    at com.dataiku.dip.futures.FutureThreadBase.run(FutureThreadBase.java:105)
[2022/09/20-14:58:14.332] [FT-TrainWorkThread-PQgu5AHu-117103] [INFO] [dku.analysis.trainingdetails] T-sI0ybdA7 - Publishing mltask-train-done reflected event

Alexandru

Hi @vaishnavi
,

Based on the logs shared and especially NullPointerException it's difficult to know the exact root cause.

Can you please open a support ticket with the model training logs and will investigate this further. We may need additional information based on the contents of the logs.

https://doc.dataiku.com/dss/latest/troubleshooting/obtaining-support.html

Kind Regards,

Alex