How to trigger a continuous python recipe and populate dataset using scenarios?

Shweta

Hi team, I am trying to use dataiku applications and flow is like one continuous recipe with output dataset and also created scenario for triggering continuous recipe and populate the dataset after creating an instance of my application, scenario is running successfully but not populating the dataset. I also to tried to populate the dataset by adding triggers but it didn't. So how to do it?

Turribeach

You can use a Python step and the code I shown on this post:

Turribeach

May 28, 2024

You can use the Dataiku API to check which continuous recipes are running and start them if needed. Below is a code snippet. You could create a new continuous recipe that monitors your other continuous recipes and starts them as needed.

import dataikuclient = dataiku.api_client()project = client.get_project('some project key with continuous activities')continuous_activities = project.list_continuous_activities()for recipe in continuous_activities:recipe_running = str(recipe.get_status()['mainLoopState']['futureInfo']['alive'])print(str(recipe.recipe_id) + " - Running: " + recipe_running)if recipe_running == "False":recipe.start()

Unfortunately the new Community site has broken all previous code blocks so it's hard to understand them. Please vote for this Idea to get them fixed:

Code blocks gone in new Community...

Turribeach

Jun 29, 2024

It seems all the previous code blocks are gone. Below is a sample post. I makes previous code snippets completely unusable.

In addition to this the "new" code block option seems hard to find / discover (you have to click on inverted P icon) and it doesn't seem to support different languages and syntax colouring.

import dataiku
import dataikuapi
import timedataiku_url = 'https://dss_url/'dataiku_api_key = 'API key'
external_client = dataikuapi.DSSClient(dataiku_url, dataiku_api_key)
external_client._session.verify = False
internal_client = dataiku.api_client()

This is major issue for me and big turn off for me if not fixed.

Before:

https://us.v-cdn.net/6038231/uploads/JAIKDL3T8A62/image.png

Now:

https://us.v-cdn.net/6038231/uploads/F63YUGHPVQLT/image.png

---

View Post

Shweta

Turribeach

Jun 30, 2024

You can use a Python step and the code I shown on this post:

https://community.dataiku.com/discussion/comment/43288#Comment_43288

Unfortunately the new Community site has broken all previous code blocks so it's hard to understand them. Please vote for this Idea to get them fixed:

https://community.dataiku.com/discussion/43851/code-blocks-gone-in-new-community

Hi, thank you for reply. It worked.