Common dataset for all outputs in all projects.

Registered Posts: 27 ✭✭✭✭

Hi i am trying to create a project structure as below image.

project str.PNG

The arrows represent etl operational recipe or model recipe.

I need to write my plugin output to the common output dataset where it will be sent for reporting layer.

how can i do this, adding the rows into the dataset every time i run the flow or model.

please share a sample project bundle for a better understanding.

Thanks

Answers

  • Dataiker Alumni Posts: 176 ✭✭✭✭✭✭✭✭

    Hi @sasidharp

    If you need to combine the results of your projects into a common dataset, you will need a commonplace to do this.

    This could either be:

    • a fourth project, to which all the other's share their outputs.
    • one of the existing projects, with the other two sharing their outputs to it.

    In this commonplace project, you will combine your outputs (using a stack or prepare recipe) and then push into your reporting layer (assuming it's indeed a push and not a pull).

    I hope this helps!

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.