Best choice : replacement of datasets in a flow (conformity of filed datasets)

Options
Kevin_dataiku67
Kevin_dataiku67 Registered Posts: 2

Hello all,

Thank you for your future answers.

I explain my problem. I will have several datasets (Excel) that will have to be joined together before undergoing processing (no problem with the join recipes and the rest)

However, these datasets will have to be replaced every month to undergo the same treatment (same flow). One of my solutions is to create folders for each dataset before the flow and to make python to check the conformity of the datasets deposited in each folder and then to make the joins and treatment (calculation).

Do you think it's possible to do it without code for the verification of datasets deposited in the folders? Is it better that I manage only the verification of datasets filed with code and do the rest with recipes?

I am looking for the best solution, thank you very much

Tagged:

Answers

Setup Info
    Tags
      Help me…