Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Added on August 2, 2024 3:28AM
Likes: 0
Replies: 2
Hi team,
I created the pipeline and set the scenario for it, but it takes soooo much time to run the scenario.
Once I clicked "run" button, green triangle mark("▶" in green) is shown in a specific dataset for over 20 minutes…
Does this mean the dataset has so much updated data? or just any mis-setting on scenario?
Scenarios don't add runtime to your jobs so this is a problem with your job not the scenario. Look at the job log to figure out what's happening.
Please check the target recipe from the following perspectives:
- The execution engine is not labeled "slow.
- The data source to be processed is not more than a few GB.
- In the case of partitioning, is there any unnecessary duplication of calculations?
- Is there any unnecessary duplication of calculations in case of partitioning?