Seeing all model Time Series Forecasts in Dataiku Plug-in

Options
m_schneids
m_schneids Registered Posts: 7 ✭✭✭

Hi-

I am using the time series plug-in for a project. I am using the AutoML - High Performance and would like to see all of the model predictions, not just the model that has the best performance statistics. Is this possible? If so, how do I go about seeing all model predictions?

Tagged:

Answers

  • Emma
    Emma Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer Posts: 52 Dataiker
    Options

    Hey @m_schneids
    ,

    It is possible to see predictions for all models. From the "Forecast Future Values" recipe:

    Selection Mode: Manual

    Model name: All models

    This will forecast values for every trained model.

    Screenshot attached. Please let me know if that helps!

    Emma

  • m_schneids
    m_schneids Registered Posts: 7 ✭✭✭
    Options

    So I can only select one model at a time?

  • Emma
    Emma Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer Posts: 52 Dataiker
    Options

    Hey @m_schneids
    ,

    No! You can select to see the predictions of ALL your trained models.

    Using the Forecast Future Values recipe select 'All Models'. This provides forecasted values from all the trained models. Each date + model type gets its own row. You can find out which algorithm generated the results in the 'Model' column (screenshot).

    Option two is to look at the Evaluation dataset you created from the Train and Evaluate Forecasting Models recipe and see the forecasted value from all of the models you trained (screenshot). Note, that this is meant for evaluating the performance of your model and will provide info only on the data that was used to train the models.

    Let me know if you have further questions,

    Emma

  • m_schneids
    m_schneids Registered Posts: 7 ✭✭✭
    Options

    Hi Emma-

    Thank you for that insight, however, in the Forecast Future Values recipe I do not have the option to select 'All Models'. Please see screenshot below.

    Matt

  • Emma
    Emma Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer Posts: 52 Dataiker
    Options

    @m_schneids

    Good catch! The 'All Models' option was introduced in version 1.2.0 of the plugin so you will have to upgrade to take advantage of the functionality.

    Upgrade the plugin by going to the 9-Box/Waffle menu along the top bar > Plugins > Forecast, click 'Update'!

    Emma

Setup Info
    Tags
      Help me…