Load different dataset based on parameter from same flow

Highlighted
raviagrawal
Level 2
Load different dataset based on parameter from same flow
Hi,

I am working for a project where I have to create Test & Control data set based of different date parameter but logic to create the dataset is same for both flow. I want to create only one flow so that I do not need to code twice but load it in two different dataset as output. Could you please help me how to create such a flow ?
2 Replies
Highlighted
Alan_Fusté
Level 3
Re: Load different dataset based on parameter from same flow

Hello raviagrawal,



The best option for you is to create a Plugin (a Python Custom Recipe). Here https://academy.dataiku.com/latest/tutorial/plugins/recipe.html you can find a tutorial about that.



As it is explained there, if you have got a Python Code Recipe created, you can convert it to a Plugin by clicking "Convert to Plugin Recipe" (in Advanced tab) and then customize your recipe.json file with custom parameters 🙂



Note about parameters:



The field "params" holds a list of all the params for wich the user will be prompted for values in the Settings tab of the recipe.

The available parameter types are: STRING, INT, DOUBLE, BOOLEAN, PASSWORD, SELECT, MAP, COLUMN, COLUMNS, TEXTAREA

0 Kudos
Highlighted
cperdigou Dataiker
Dataiker
Re: Load different dataset based on parameter from same flow
You can run your flow on the complete dataset, then split the output dataset into Test and Control results with a split recipe.
0 Kudos
Labels (2)