Deep Learning Feature Importance

dkuzanek76
dkuzanek76 Dataiku DSS Core Designer, Registered Posts: 3 ✭✭✭✭

I'm using v13.3.2, and notice Feature Importance is not available for DL models … it that available in v14 ?

Dataiku version used: 13.3.2

Answers

  • juliendataiku
    juliendataiku Dataiker, Registered Posts: 9 Dataiker

    Hi,

    Thanks for reaching out! To answer your question, the "Feature Importance" functionality is unfortunately not available for Deep Learning Models in DSS 14 either.

    To help us better advocate for this feature, could you share a bit more about your specific use case and how would having the feature importance impact your current workflow or model validation?

    We’d love to hear more details, as we value this kind of input.

  • dkuzanek76
    dkuzanek76 Dataiku DSS Core Designer, Registered Posts: 3 ✭✭✭✭

    Thanks for the reply … I run all ML models, with variations of featured data sets - then generate a large confusion matrix to determine the Top X model / feature combinations … from there I use the Top Y features within the Top X combinations to work up a confidence factor based on the mean / std dev of the Top Y features (R2 is a decent gauge of overall confidence, but doesn't do well in my performance analysis) … Deep Learning Keras models are starting to show up in the Top X, and it sure would be nice to use those Top Y features in my "confidence" calculations

  • juliendataiku
    juliendataiku Dataiker, Registered Posts: 9 Dataiker

    Hi,

    Thanks a lot for the detailed feedback and use case. I will make sure to pass along this information internally.

    Have a great weekend!

Setup Info
    Tags
      Help me…