OneDrive - Schema Refresh/Update
Hi,
We are trying to refresh the dataset schema which we are calling using OneDrive Plugin, and Dataset schema is not getting updated/refreshed even if changed at source.
Thanks & Regards,
Vijay
Operating system used: Ubuntu
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,118 Neuron
What exactly are you trying to achieve? Refresh the schema seems to be the means not the objective. How exactly are you doing that? If you are using any Python code then post the code snippet using a code block.
-
Hello,
I have loaded data through OneDrive Plugin, Whenever reloading the schema the data is getting refreshed but not the Column Name (Schema) even when it is changes at the source.
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,118 Neuron
Dataiku datasets don't automatically change when the underlying file changes. You need to go to the dataset Settings => Schema tab and check the schema for changes. Then accept the changes and save the dataset. If you need to load files with dynamic schemas you should use a Python recipe where you can deal with schema changes more easily.