Registered users can ask their own questions, contribute to discussions, and be part of the Community!
I created a dataset using below Dataiku's Python API.
project.create_sql_table_dataset(dataset_name, type, connection, table, schema)
I provide type = "Snowflake" and give the table and schema details, which already exists.
The problem is that, this operation also drops the table in Snowflake and re-creates it.
I saw in the logs, and found out that this happens when there is a schema mismatch between dataset and table. This is from the logs
Table already exists but with an incompatible schema: Type mismatch for column 11 (WAFER_NUM) : 'VARCHAR' in dataset, 'BIGINT'(-5:NUMBER) in table
Can you suggest any operations using which it does not drops the table in Snowflake, and a way for dataset to be created by automatically inferring whatever the schema is in Snowflake ?
Operating system used: Windows
Could you please provide the following information?
Post a Question