-
Error when executing SQLExecutor
I got an error when executing SQLexecutor function in Dataiku IPyhton. This is the command that I used: import dataiku import pandas as pd, numpy as np from dataiku import pandasutils as pdu from dataiku.core.sql import SQLExecutor2 from dataiku.core.sql import SQLExecutor dtk =…
-
Permissions for managed folders
Dear, I am creating an webapp where I want to upload files at the managed folder using public api from javascript. On the link https://doc.dataiku.com/dss/api/4.2/rest/#managed-folders-managed-folder-contents-post it is written that I need to provide permission WRITE_DATA to the Managed folder such that I can upload files.…
-
delete dataset without clearing the metrics values
Hi, I am using the python public API to clear the dataset. This deletes the data, but also the history of the metric values. Is it possible to delete just the data? And one more related question, when the dataset is linked to the folder, the clear() method does not remove the data. Do I have to look up for the folder and…
-
rename dataset by python internal API
Hello everyone! I'm working on a Python Notebook to copy paste a Project. I have already change the path of my imported Datasets like explained here: https://www.dataiku.com/learn/guide/tips/duplicate-project.html. However I can't rename the dataset like I renamed the 'hiveTableName'. Any help please? :) #Foreach datasets…
-
Create sync recipe with python code
Hi, how can I create a impala sync recipe with the Public API? I have the source managed dataset stored as parquet and I would like to create a code recipe with sql like "select count(*) from mytable" into a new parquet managed dataset. So far I have been using this, but this method assumes that the output dataset is…
-
Modify the value of a variable in a Python recipe
Hello, I'm asking this question again, because I need an answer quickly and I'm not sure my comment in the original thread will be seen. "I would like to modify the value of a variable that I declared in my project (Settings > Variables) in a Python recipe. Is it possible ?" Thanks.
-
Build a dependency tree - get the parent recipes and input datasets/folders
Hi, I know about the possibility to list all recipes from the given project and then read the raw definition to get the output and input datasets. But what I would like to know, how to get a recipe (name) if I have a given dataset? (Using the python API) Thanks Tomas
-
How do I define types on loading data in Python ?
While loading my data, Pandas translates some types wildly, transforming integer to double, strings (with only numbers in it) to decimal, removes leading 0 in strings such as "00042", and so on. I'd like to set the types of the column while loading the data, to avoid wild type conversion and screwing up my data, how can I…
-
How to lock a given dataset?
We can access a given dataset using the DSS REST API, but we would like this dataset not to be written on while it is accessed. 1) Is it possible to check whether a dataset is currently modified using the api? 2) Is it possible to lock data writing on a dataset using the api? If it's not possible to do this using the api,…
-
Connecting to a REST API
Hi, I am connecting to a rest api with end points in the following form /sensor_1? , where sensor_1 can be one of few hundred different tags. Based on the documentation, I assumed that the best way to connect to this data source is through the http connection where I give the url of each sensor in a different line. It…
