Announcing the winners & finalists of the Dataiku Frontrunner Awards 2021! Read their inspiring stories

Predict recipe vs Evaluate recipe

Levos
Level 1
Predict recipe vs Evaluate recipe

Hi,

I created a logistic regression model in DSS.

After deploying, I scored a new set of data with the Predict recipe, receiving a prediction as well as the probabilities for each class (column named "proba_1")

Then, I tried the Evaluate recipe on the same dataset, receiving close but defiantly different probabilities (hence, some predictions were also different).

I could not find in the documentation. Both recipes score and return probabilities. Why were the probabilities different?

Thanks

1 Reply
DarienM
Dataiker
Dataiker

Hello!

This could be due to the scoring engines used by the respective recipes. The Evaluate recipe uses Python whereas the Score/Predict recipes can use Optimized Scoring. This can lead to differences.

Within the settings of your Predict recipe, try checking the box "Force original backend," rerun, and see if it yields the same result as the Evaluate recipe.

Best,

Darien

A banner prompting to get Dataiku DSS