Getting an error input data set is not ready
i am using my hive query in one of the recipes in my flow. The query returns no rows .
After that recipe, i have one more recipe which joins the before dataset. which fails while run .
Throwing error input data set is not ready
can you provide and guide me the possible solutions
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 DataikerOptionsHi @SUSHIL
,You won't be able to join an empty dataset. What is the expected outcome when the dataset has no rows? Do you simply want to skip the build of this dataset?
If so you can use the record count metric and run checks in a scenario and build the output dataset only if built if the input dataset is not empty.
For your potentially empty datasets create a check - Status - Edit
In your scenario, you would want to compute metrics for the dataset and run a check on that dataset if it fail the next build step would not be run. So it would not impact the rest of your downstream recipes those can still be built.
Let me know if this helps in your case.