Accessing metrics in Dataiku Formula

Hi @schang
!

Could you provide more information on what metric are you interested in? The screenshot you provided is just a log file that shows an error, but it doesn't give any relevant information as far as I can see.

About finding the sum of a column in the prepare recipe, are you looking to create a new column with this value, or you just want to know what is the sum of a column?

Cheers

Hi @schang
,

Yes, I can see the screenshot and I understand now your use case.

Apparently, there is no way to access the metrics values from a visual recipe, at least I was not able to find anything in the docs.

Also, and again I might be wrong, the formula language available for some visual recipes do not include functions to calculate statistics from a column (sum, mean, std, etc), in a way that its results can be used to be applied to the cells. All operations, and this apply apparently also to the python option within the prepare recipe, are row by row.

I was able to find a solution using only visual recipes, but I find it not too elegant or practical. Given a dataset with columns A, B, C, where we want to dived the B rows by the sum of all the rows in column C:

1. Create a new dataset using the Windows recipe:
   • In the "windows definitions" section, select as Order Column the row A (this is irrelevant for this use case, but it is needed for the recipe to work), and activate the Window Frame definition. Do no set any limits, just activate it
   • in the Aggregations section, highlight the "Sum" aggregation for column C
   • In the Output section, you will se a new column named "C_sum", this is were the result will be stored
   • run the recipe
2. Now, process the new dataset with the extra column with a "Prepare Recipe":
   • Add a "Formula Step"
   • Name the output column
   • in the Expression block write B / C_sum

And that is it, you have what you needed. But I agree, it is not as simple as with excel.

Maybe a dataiker could provide more input? @CoreyS
?

Cheers!