Reactions
-
Re: Refresh/read schema on dataset via API
Hi @tomas , I'm not sure I fully understand what you're trying to achieve. Where does the data from which you want to read the schema come from? How is it stored? Since a python recipe allows alterin…1 · -
Re: Refresh/read schema on dataset via API
Hi @tomas , Thanks for these additional details! With Dataiku 8.0, you can now programmatically perform the schema autodetection using the autodetect_settings() method of the dataset object, that you…1 · -
Re: Spark Pipeline Initial Dataset Creation
Hi Anne, You can clear the data of these datasets from UI. In the flow, select one or multiple datasets (shift + click) and use the clear data option available in the right-hand side panel. (The same…1 · -
Re: Spark Pipeline Initial Dataset Creation
Hi @aw30 , Enabling the Virtualizable in build option of a dataset, allows it to be virtualized only when the job you run doesn't require it to be materialized. If the virtualizable dataset is the ou…1 · -
Re: Calling external API
Hi @aw30 , To write the output of a code recipe into a DSS flow, you should use the Dataiku API to write either in a dataset or in a managed folder. By default when creating the python recipe, DSS ha…1 ·
