Run in parallel a recipe or part of your flow for different parameters

PapaA

Hi all,

We have one main file that calls all our pipelines from our library which has been set up dynamically with global variables (not dataiku ones but normal ones). These global variables / settings live in our git repository.

We want to use this main file to run multiple jobs for different settings of our settings.py file.

We also want these jobs to run in parallel rather than queening up.

How is that possible?

Can I create a scenario define the jobs there and then let it run?

PapaA

@Dataiku
Could you give support on this?