-
hive.ql parse ParseException
can anyone please help on the below error, its happening frequently while running the recipes Oops: an unexpected error occurred Error while compiling statement: FAILED: ParseException line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column…
-
Schema Change in Dataiku recipe Dataset
Hi Guys, is there any way to convert the storage data type of a column into the required/expected type, as dataiku detects the schema automatically while creating the recipe dataset, it has becoming tough day by day to work on these kind of changes, kindly please provide your suggestions. before any response do check the…
-
Dashboard not updated when dataset informations change
Hello, From a dataset i created some cards in the sheet "Statistics" in order to analyse some variables. Then i added some of these cards on a dedicated Dashboard. I'm surprised to observe that my cards are well updated when the dataset information change but not the Dashboard. Do you know if a specific set up need to be…
-
Changing Dataset connection in Python recipe has to be run twice
Hi All, I have a Python recipe that outputs a SQL Dataset. I wish to control to which SQL Database the output Dataset is written to. I have been able to do it with the following code: import dataikuimport pandas as pd#Change output DataBase for "MyDataset"client = dataiku.api_client()project =…
-
Pre-filter vs post filter in join recipe
I am using a pre-filter criteria in join recipe and then using a left join but somehow it seems the joining is taking place on all dataset instead of dropping the rows according to the pre-filter comdition but its working fine if I am using the post join filter,I am confused why in the first place the pre-filter isnt…
-
Struggling with the most basic of custom triggers
Hello- I am struggling with the most basic of custom python triggers. I have it set to fire every minute but nothing happens! I pulled the syntax from…
-
Exporting a Dataset into Multiple .CSV files
I have a dataset that will have to be imported into another system as a series of .CSV files. Is there a way to have DSS write several files into a folder based on selection from several columns of the dataset. For example if I had a vehicle dataset. With Cars and Trucks, with 4, 6 and 8 Cylinder Engines. I'd like all of…
-
Split Dataset Into Files of n Records Each, Deliver via SFTP
I have a business requirement to deliver a dataset via SFTP, but the dataset must be split into files each containing n records. There can be a different number of records each time, which means there can be a different number of files each time. This requirement is based on a size restriction of records per file in the…
-
Write a marco which will shut down all of the notebook kernels on a instance
Hello, Im reading in the documentation that it is possible to write some sort of macro which will shut down notebook kernels on an instance https://doc.dataiku.com/dss/latest/operations/processes.html "Administrators can also automatically kill Jupyter kernels that have been left alive for too long using a dedicated macro"…
-
Run code snippet before or after every recipe in project
Is there a way to run a small code snippet before or after every recipe (both visual and code recipes) ? I could achieve this by appending a code recipe to every existing recipe but hoping not to "pollute" my flow unnecessarily concrete use case: I'd like to optionally adjust datasets after each point depending on my…
