-
Write html file to azur blob storage with content type text/html
Hello, I am trying to write an html file with the help of a python recipe into a folder which is located on a blog storage. The writing works so far, but unfortunately the content type of the file is not text/html, but application/octet-stream. In the Element folder in Dataiku I have set the Content Type to text/html under…
-
Disable dash instance created before running dash project on dataiku
Hello, I have developped a dash web-app using Dash packag, and it works well locally. However, once I have uploaded it to Dataiku, it is not working as expected. My question is: how should I remove the "app = dash.Dash(...)" instance defined in dataiku? Is there a way to disable it and enable the dash instance declared in…
-
Bar chart - How to display the count of a column ?
Hi everyone, Hope your are all doing good. I was wondering if there is a way to create a bar chart with just using x axis and y would be the count like if we have this dataset : i just would like to have one bar with count of Id (equal to 3) and not the count per distinct id id | name | 1| curry | 2| adebayo | 3| doncic|…
-
DSS Managed Folder Issues
I get the following error when I run the python below in DSS Error: Job failed: Error in Python process: At line 14: <class 'AttributeError'>: 'DSSManagedFolder' object has no attribute 'list_objects' See actual Python script below import dataikuimport pandas as pdclient = dataiku.api_client()project =…
-
Update schema of existing hive partitioned tables (HDFS)
Currently, my workplace has two servers for Designer nodes, one for "lower environment" and another one for "production". When we want to deploy to Prod, we will create the project bundle from the lower env and import to Prod designer node. Getting to my question: In the lower env, when there is an existing partitioned…
-
When trying to execute a SQL recipe we have the error SHOWPLAN permission denied in database
When trying to execute a SQL recipe in a dataiku flow, we have the error SHOWPLAN permission denied in database. We tried to set the advanced options for the SQL recipe to not display the execution plan. We tried to uncheck the validation before the run. Are there any other settings we need to modify to disable the…
-
Dataset Left Anti Join - issue with decimals
Hi all, I have two datasets that are similar in their structure and my goal is to get a dataset that has records of the left table that do not have a match in the right table and as a result, I used Left Anti Join. I am matching the tables on a number of keys and one of those keys is a column which is of type decimal…
-
Why are projects and API endpoints not showing up in the Unified Monitoring?
We have API endpoints and projects set up in the automation node, but they are not showing up in the Unified Monitoring. Things I did to try to add the API Endpoints and Projects to the monitoring: * Projects:* Deployed a new project to the automation node * API:* Set up event server * Set up the automation node as an…
-
How to change string/text data type to double/decimal throughout a build?
Hi all! This the following scenario on a build: I have a dataset D1 pulling in data from a SharePoint folder with several CSV files. One of the columns in the D1 dataset has decimal numbers which contains a % symbol. Dataiku reads it as a string/text data type. If I change the data type to double/decimal - all the data in…
-
Schema evolution: CSVs with varying headers
When creating a dataset from a list of csv files, dataiku detects the schema of the first file (or can be overridden with the schema of one manually selected file). I have collections of files where the schema slightly changes over time: * New columns are added * Some columns are removed * Some columns change position With…