Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
hi,
I created a dataset using below Dataiku's Python API.
project.create_sql_table_dataset(dataset_name, type, connection, table, schema)
I provide type = "Snowflake" and give the table and schema details, which already exists.
The problem is that, this operation also drops the table in Snowflake and re-creates it.
I saw in the logs, and found out that this happens when there is a schema mismatch between dataset and table. This is from the logs
Table already exists but with an incompatible schema: Type mismatch for column 11 (WAFER_NUM) : 'VARCHAR' in dataset, 'BIGINT'(-5:NUMBER) in table
Can you suggest any operations using which it does not drops the table in Snowflake, and a way for dataset to be created by automatically inferring whatever the schema is in Snowflake ?
Operating system used: Windows
Operating system used: Windows
Hi @yjagger,
Could you please provide the following information?