Not getting the latest data when scenario is triggered in Dataiku Automation node
Hi,
I've deployed a project on Dataiku Automation Node, have activated the scenario also, however, while downloading the final dataset, not getting the latest run data. Kindly guide.
Thanks,
Parul.
Answers
-
RoyE Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 31 Dataiker
Hello Parul,
Can you try to manually run the scenario by selecting the green "Run" button on the scenario page?
If this works and you are able to see the latest run data in the "Last Runs" tab, can you confirm in what way you are triggering your scenario? (IE: Time-based Trigger)
It is possible the current trigger that you have set up is not working properly and therefore you are unable to get data in your latest run.
Lastly, can you specify what you mean by the final dataset does not contain your last run? Have you set up a "write to dataset" reporter?
-
Hi RoyE,
Thanks for the solution. I've checked the Scenario, it's running fine.
However, now I'm facing data leakage when I'm doing data preparation with Python code. Any idea how to fix that?
Thanks,
Parul.
-
RoyE Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 31 Dataiker
Hello Parul,
Could you please make a new community post about that issue with further details on the issue for visibility purposes? Please add details on what exact data leakage that you are experiencing, and if possible the code that you are using.
Thank you!