-
Python recipe random connection aborted errors to managed folder
We have a on-prem DSS installation. I have a folder of SFTP type to read from a remote server. My python recipe uses this as input. I'm using get_download_stream() to read the files like so: handle = dataiku.Folder('my_folder') handle.get_download_stream('path/to/file') Now this is looping through several hundred files and…
-
[Webapps] Shiny for Python ?
Are there any plans to add Shiny for Python to web application development frameworks? Same question for Django and Flask. Thank you, Alexis
-
Dataiku development settings: CI, VSCode, Remote repository
Hi all, I've read the guide to connect dataiku dds to a github remote repository to manage branch creations through the use of duplication of projects, but I have some doubts about its usage since what seems to me is that to use it I still need to have a master project, and many copies each for each branch. And this number…
-
How to rate limit number of records processed per second
Hello, I'm new to dataiku and I have a scenario where I have to send emails. Now I am using send_emails plugin to send emails, but my smtp server has a limit that it can process only 40 mails/second and I want to ensure that only 30 mails are being sent per second. Is there anything that can limit only 30 records being…
-
DSS Memory Management Webapp consumption buildup
Hi, so we have quite a number of webapp backends runing on production server and this leads to out of memory situations. We would like to tend to this issue by implementing a backend cleanup routine for long running webapps. Is there a way to get a timestamp for webapp start ? Or is there a better way to go around for this…
-
Connecting to a sharepoint list and appending new rows
I am trying to connect to a particular SharePoint list of our team, so we can automatically append new entries. However, i have a very hard time establishing the connection. I am doing this with a manual Python recipe. Can someone help me? Operating system used: Windows
-
How to optimize dataset batch writer for long-running tasks?
We have a compute and memory-intensive Python recipe that we are building. The recipe both reads and writes from/to Snowflake-based datasets. We are running into an issue where the task fails at the end of the code when the context manager closes and the dataset writer attempts to commit the transaction. Solution 1: The…
-
Is it possible to download a trained model as Python file?
I've got confused by the documents provided. I'm currently working with the trial edition and so far haven't been able to get my trained model as a .py file. I'd be glad if someone helped me.
-
HTTP status codes returned by DSS API node/service
Two questions: 1. Will an exception, raised during execution of API service code, always result in a response with a 500 HTTP status code? 2. Aside from that, errors can occur outside of API service code execution (e.g. service is unavailable). Is there an overview available of which situations map to which HTTP status…
-
Write the schema of a pandas dataframe using the "dataikuapi" variant
Hello, Dataiku team. How can I write the schema of a pandas dataframe using the "dataikuapi" variant? I'm doing it this way because I want to send information from the api node to a table in my project in the layout node. I want to write the schema like when using the dataiku library: df_final.write_with_schema(df). But,…
