-
text data preprocessing using the available visual recipes
THERE ARE A RECIPE VISUAL TO DO Data Preprocessing with Visual Recipes in Dataiku for textuel data ?
-
Unterminated quoted field at the end of the file
After our recent update to Dataiku 12 our data has been behaving oddly in dataiku. We encountered this problem https://doc.dataiku.com/dss/12/troubleshooting/errors/ERR_DATASET_CSV_UNTERMINATED_QUOTE.html Before setting the quoting style to 'Unix' from 'Excel' (default) the job wouldn't finish at all. Now it finishes but I…
-
Saving an audio file to S3
Hi, I am trying to perform a Text-to-Speech conversion task, I am able to convert the text using the gTTS library in python, but when I am trying to save it to a S3 folder. I am getting an empty file. But saving it locally and playing in the notebook works. Let me know if there is a way to save audio files in S3. Thanks.…
-
Env variable cannot be set
I'm trying to load a transformer model through the env Resources but it does not work as it does not set the variables I tried the following as a test: ********************************************************* {'value': 'This is a test', 'type': 'RAW_STRING'} ********************************************************* In the…
-
How can I check progress of LLM summarize recipe?
If I want to run the "summarize text" recipe on, say 20 000, documents - is there a way I can see the progress of the recipe while it's running?
-
Issue converting dataset to JSON
Hi All, I'm trying to convert a dataset into a JSON format by using a python script and then calling it via Postman to use it externally. I am running into an issue when calling to Postman, it never seems to read the formatting correctly and it prints a series of arrays (attached image) Here's the code that I'm using:…
-
Selecting the latest file added in a folder using Python
Hi All, I would appreciate it if someone can provide me with a python script to select (read_csv) the latest csv file in a SFTP folder? Currently I am using the following script to read csv files from a SFTP folder, however when we have multiple files added in different dates, I would like to select only the latest one…
-
Scenario Reporters
Currently using Scenario reporters to send data to a dataset with below configuration. { "flowname": "${scenarioName}", "status": "${outcome}", "summary": "${failedEventsSummary}" } The issue is failedEventsSummary is providing too much text. How can we get just the ERROR on why the scenario failed. Operating system used:…
-
How to upload TDE (tableau) file to DSS?
Hi, I want to upload a TDE file from tableau server to DSS. How should i go about it? Narayan
-
IF contains multiple conditions
colAB310 if(contains(toUppercase(col),"A"),"letters",if(contains(toUppercase(col),"B"),"letters","others")) The code above works but is it possible to shorten it to combine the logic for "A" and "B"? For example in the syntax below (albeit incorrect): if(contains(toUppercase(col),"A" or "B"),"letters","others")
