Load different dataset based on parameter from same flow

[raviagrawal]

Hi,

I am working for a project where I have to create Test & Control data set based of different date parameter but logic to create the dataset is same for both flow. I want to create only one flow so that I do not need to code twice but load it in two different dataset as output. Could you please help me how to create such a flow ?

[Alan_Fusté]

Hello raviagrawal,

The best option for you is to create a Plugin (a Python Custom Recipe). Here https://academy.dataiku.com/latest/tutorial/plugins/recipe.html you can find a tutorial about that.

As it is explained there, if you have got a Python Code Recipe created, you can convert it to a Plugin by clicking "Convert to Plugin Recipe" (in Advanced tab) and then customize your recipe.json file with custom parameters 🙂

Note about parameters:

The field "params" holds a list of all the params for wich the user will be prompted for values in the Settings tab of the recipe.

The available parameter types are: STRING, INT, DOUBLE, BOOLEAN, PASSWORD, SELECT, MAP, COLUMN, COLUMNS, TEXTAREA

[cperdigou]

You can run your flow on the complete dataset, then split the output dataset into Test and Control results with a split recipe.