Real time execution of scenario based on data
jc
Partner, Registered Posts: 1 Partner
Hi all,
I was wondering if it was possible by any means to have a real time execution of Dataiku scenarios.
The scenarios would be triggered by any change in input data.
Thanks for any answer.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,218 DataikerHi,
You could look at https://doc.dataiku.com/dss/latest/scenarios/triggers.html#dataset-modification-triggers for scenarios
By default, it will evaluate this every 900 seconds but it's configurable. However, evaluating this too often e.g every 30 seconds would not be recommended and is likely unnecessary in most cases.
You can also the option to use the API directly, https://doc.dataiku.com/dss/latest/python-api/scenarios.html so if you have a particular event that updates your input data then you can trigger a run of the scenario.