Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

How do I update an uploaded dataset?

Level 1
How do I update an uploaded dataset?
I am still a newb at DataIku.

Here's my issue. I am moving a data transformation from Tableau Prep to DataIku. The data source we are using has yet to be transferred to the cloud, so we are working from three .csv extracts. The extracts are run 3 times a week and stored on a share drive. Therefore, I need to update the flow with the new data three times a week.

I cannot find a way for DataIku to do that without destroying the flow. Is this possible? If not, why?
2 Replies

You can go in the settings of the uploaded datasets and upload your new data files, then you can rerun the Flow. Would that work ?
You can put your files in a Managed Folder, or define a Managed Folder in the flow that points to [a mount of] your shared directory.

You can then define a "Files in Folder" dataset over that Managed Folder, that reads the files in said Managed Folder.
0 Kudos


Labels (1)
A banner prompting to get Dataiku