PROTECT SCHEMA OF POSTGRES TABLES
Hello,
When I launch recpies, it appears that output datasets connected with a postgres tables erase all parameters of this table, including schema, constraints, foreign keys, etc. I would imagine a possibility to manage conflicts between the existing table and the dataiku output.
Is there any possibility to protect these informations from dataiku WFL + to manage conflicts ?
Thanks
J.
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron
Please read this documentation section to understand the difference between managed and external datasets:
https://doc.dataiku.com/dss/latest/concepts/index.html#managed-and-external-datasets
The output of any recipe MUST be a managed dataset. The inputs can be managed datasets or external datasets that Dataiku won't touch. For the output datasets it is highly recommended to have a separate database/schema where to store them to avoid clashes with source data sets.