Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hi,
I have flow where I do not update/write intermediate dataset.
Could you please help, how can I achieve this.
Hi @dhyadav79 ,
If you are using SQL Pipeline or Spark Pipelines avoid building intermediate datasets.
by seting the dataset โVirtualizable in buildโ See:
If you are not using pipelines but you simply want to protect this dataset, then set it to "write-protected" Advanced tab - Rebuild behavior