New to Dataiku DSS? Try out our NEW Quick Start Programs today and get onboarded on the product in just one hour! Let's go

How to get Variable Importance from Model

lugow
Level 1
Level 1
How to get Variable Importance from Model
Hi,

I want to automatically consume the data on the "Variable Importance" area under the "Interpretation" section of a trained model. I see that I can manually export this data, but what I am trying to do is to get this data in a dataset or something similar where I can build pipelines on top of it.

Is that possible?
0 Kudos
3 Replies
Alex_Combessie
Dataiker
Dataiker

Hi,



Please find below a piece of code to retrieve variable importance raw data for a trained model in an Analysis:




import dataiku
import pandas as pd

client = dataiku.api_client()
project = client.get_project(dataiku.default_project_key())
analysis = project.get_analysis("rGRd5qWg")
ml_task = analysis.get_ml_task("fm97lWNq")
trained_model_ids = ml_task.get_trained_models_ids()

trained_model_detail = ml_task.get_trained_model_details(trained_model_ids[0])
feature_importance = trained_model_detail.get_raw().get("iperf").get("rawImportance")
feature_importance_df = pd.DataFrame(feature_importance)


Note that you can get the analysis_id, ml_task_id and trained_model_id from the URL of the page of the model. Or you can get that using our API: https://doc.dataiku.com/dss/latest/python-api/rest-api-client/ml.html#exploration-of-results



Hope it helps,



Alex

lugow
Level 1
Level 1
Author
This is awesome!!. Thanks!.
0 Kudos
omri17
Level 2

Hi Alex,

This is really awesome.
I saw you referred to the "get_raw()" method. I didn't saw any reference for it in the docs. Is it?
How, for example, i can get regression coefficients in a similar approach?


Thanks,

0 Kudos
Labels (1)
A banner prompting to get Dataiku DSS