Do not update or write intermediate dataset
Options
![dhyadav79](https://us.v-cdn.net/6038231/uploads/Dataiku/nAvatar5.png)
dhyadav79
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Registered Posts: 21 ✭✭✭✭
Hi,
I have flow where I do not update/write intermediate dataset.
Could you please help, how can I achieve this.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 DataikerOptions
Hi @dhyadav79
,
If you are using SQL Pipeline or Spark Pipelines avoid building intermediate datasets.
by seting the dataset “Virtualizable in build” See:
If you are not using pipelines but you simply want to protect this dataset, then set it to "write-protected" Advanced tab - Rebuild behavior