-
Best Way to integreate GIT with Code Studio for version control
We have in house python package developed and they are used as main building block for DSS Recipes. And recently we start to integrate Code Studio with hope to use it as the main IDE for development work directly on the cloud. We currently has a Code Env which include all the in house python package we develop, and we can…
-
Long Queue Time in Jupter notebook
Recently we start to experience a long queue time when we run multiple block in DataIKU jupyter notebook. The block will show execution queued and it will take a long time until the block get executed and return the result, even when the block only try to calculate simple formulas like 1+1, and the actual exectuion takes 5…
-
The 'exec_recipe_fragment' method of 'SQLExecutor2' class fails to perform
Hello, I was exploring the following code example: https://developer.dataiku.com/latest/tutorials/data-engineering/sql-in-code/index.html#code-recipe-examples But I got an error from the exec_recipe_fragment method (attached below). I tried both options of the overwrite_output_schema parameter but did not succeed. Any help…
-
Best practices for real-time APIs?
Has anyone got any best practices they can recommend for development, testing and deploying real-time API services? At the moment we have considered documenting and testing under load. Does the community know of anything else we can add?
-
Append each refresh into a separate dataset
Hi team, I currently have a dataset that connects to an online sharepoint, with the scenario function it is now autorefreshed weekly. I would like to build a new dataset to append all the versions to compare the changes/ evolution. Could you help with some guidance? many thanks
-
Default variable values in an Application
Inside an Application, I define an "Edit project Variables" section, followed by my variable definitions: an "INT" and a "STRING". =========== [ { "name": "welcome", "label": "on", "defaultValue": "5.2 is my game", "mandatory": true, "canSelectForeign": false, "markCreatedAsBuilt": false, "allowDuplicates": true,…
-
where can i found the detailed API functions for scenario interaction
For example, I can find the function train_model(model_id, project_key=None, build_mode='RECURSIVE_BUILD', step_name=None, async=False, fail_fatal=True) But how could I know what kind of object this function returns, and how can I use with that returned value? From the sample code, I found function…
-
evaluation store
can we use evaluation store output for further processing using python recipe.
-
Automatic mapping not supported for Elasticsearch
I'm using a connection to my ElasticSearch cluster to write some of my datasets into index. If I use the default mapping , the types of the schema are well mapped (date into date, string into text, integer into long, boolean) but text have not keyword subfield. I know I can generate for ext field the keyword subfield by…
-
Calling dataset from API deisgner failed
How to call the dataset in Python function from API designer? im using Python function, and in the function, I'm using below function: def testing_example(parameter1): dataset = dataiku.Dataset("datasetname",project_key="project_id") df = dataset.get_dataframe() But it fails. Any idea how to solve this?