Getting an error input data set is not ready

SUSHIL
Level 3
Getting an error input data set is not ready

i am using my hive query in one of the recipes in my flow. The query returns no rows .

After that recipe, i have one more recipe which joins the before dataset. which fails while run .

Throwing error input data set is not ready 

can you provide and guide me the possible solutions

 

0 Kudos
1 Reply
AlexT
Dataiker

Hi @SUSHIL,

You won't be able to join an empty dataset. What is the expected outcome when the dataset has no rows? Do you simply want to skip the build of this dataset?

If so you can use the record count metric and run checks in a scenario and build the output dataset only if built if the input dataset is not empty. 

For your potentially empty datasets create a check - Status - Edit 

 

Screenshot 2022-01-14 at 11.59.55.png

In your scenario, you would want to compute metrics for the dataset and run a check on that dataset if it fail the next build step would not be run. So it would not impact the rest of your downstream recipes those can still be built. 

Screenshot 2022-01-14 at 11.59.25.png

Let me know if this helps in your case. 

0 Kudos