-
Read and write to samefile
Hi, I have a scenario which where we are reading the input from different file and one file among all input files is an out file too. When we do this we are loosing some data may be due to parallelism in dataIku. My request is how to stop writing to the file till the entire execution of receipes completed. I saw some posts…
-
How to selectively build multiple flow zones in a job run?
Hi Dataiku Community, I wonder how to select and build multiple flow zones in a job run. Say, I have 4 flow zones, A, B, C, and D. They are connected in such a way as follows: A -> C -> D B -> C -> D. How can I do that if I want to build the top route, i.e., A -> C -> D in a single job? Thanks! Operating system used:…
-
Multivariate LSTM in Dataiku
I've completed this tutorial on how to implement an LSTM in dataiku. https://knowledge.dataiku.com/latest/kb/analytics-ml/time-series/ts-forecast/time-series-code/deep-learning-ts.html Basically I want to understand how to adapt this for multiple variables. I have a data set that has many 'runs' of a chemical process over…
-
Create a variable using values from a table
Hi everyone, in my Dataiku flow I have a table (T-DATA-QUALITY-40) that gives me an output consisting of a row with 3 columns. This is the output of the table How can I create a new variable with the value of the second column (ANNO_CALENDARIO) ? Thanks in advance!
-
Get complete jobs history
Hi, I saw in this link :https://doc.dataiku.com/dss/latest/operations/disk-usage.html that the job logs are not garbage collected and are retained in the DSS for arbitrary time. But when I use the following code jobs = project.list_jobs() I get only the most recent 100 jobs information. Is it possible to get the complete…
-
Dataiku API
Hello everyone. I'm trying to build an application outside Dataiku to run a workflow that has been built within Dataiku, so I would like to know if it's possible to create that Web App that can be used by everyone (not necessary logged into Dataiku), so they can upload their own data and retrain the model I'm building,…
-
Run macro xlsm or xlsb files on Dataiku
Hi, Could you please advise, whether can we run macros from .xlsm or .xlsb files through dataiku, without migrating them into R or Python recipes. I am interested to automate the process flow using dataiku. Dataiku version : 12.6.1
-
ValueError Load .md file format using Langchain DirectoryLoader
Hi, I was trying to read .md file format using Langchain library DirectoryLoader. Here's the code. import dataiku import os from langchain.document_loaders import DirectoryLoader FILE_NAME = "alice_in_wonderland.md" # Load the file and split it into smaller chunks docs_folder = dataiku.Folder("file1") # Replace with your…
-
Running my streamlit app outside of code studio
Hi, Using code studio was not possible, due to the Python version restriction, so I created a blank Python web app. My streamlit app is stored in a Python package, which I uploaded into my project's code environment. I ran my streamlit app file and got the following error: 2023-05-17 17:06:14.042…
-
Is there a list of all the builtin variables like ${projectKey}, ${dssUserLogin}, etc
I noticed the user of some builtin variables in the documentation like: * projectKey jobProjectKey * dssUserLogin * jobProjectKey * jobId * activityId but it's there a list somewhere with all the possibilities, and where they can be used? For example is not clear to me if I can use ${jobProjectKey} in the Administration >…
