Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

append instead

Solved!
NR
Level 3
append instead

Hi,

Sync recipe is dropping table instead of appending.

dataset schema are the same. I checked the discussions about similar issue but still not working.

Sans titre.png 

0 Kudos
1 Solution
AlexT
Dataiker

Hi @NR ,

If you use Dataiku Cloud with Dataiku-managed-storage you will have parquet used by default.
Append is not compatible with parquet format,


You will need change the output type to a CSV by navigating to the Inputs/Output [1] tab of your python recipe. From there go to the Format [2] drop down menu and select CSV [3].

Screenshot 2023-04-26 at 2.18.42 PM.png

Thanks

View solution in original post

1 Reply
AlexT
Dataiker

Hi @NR ,

If you use Dataiku Cloud with Dataiku-managed-storage you will have parquet used by default.
Append is not compatible with parquet format,


You will need change the output type to a CSV by navigating to the Inputs/Output [1] tab of your python recipe. From there go to the Format [2] drop down menu and select CSV [3].

Screenshot 2023-04-26 at 2.18.42 PM.png

Thanks