Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Left join of empty dataset
Added on May 15, 2019 1:35PM
Likes: 0
Replies: 3
Tomas
Registered, Neuron 2022 Posts: 121 ✭✭✭✭✭✭
Hi,
I have a join recipe (left join) where one of the joined table is empty (it is calculated sucesfully but empty). The recipe fails with an ERROR that the input dataset is not ready. How to avoid this error?
Thanks
I have a join recipe (left join) where one of the joined table is empty (it is calculated sucesfully but empty). The recipe fails with an ERROR that the input dataset is not ready. How to avoid this error?
Thanks
Best Answer
-
Was it computed by Impala ? If it was, unfortunately, a behavior of Impala is that if there are 0 output rows, it doesn't even create an empty file, which leads DSS to think that the dataset isn't ready. There is no workaround apart from changing the engine which computed the empty dataset.
Answers
-
Yes it was.
-
Is it the same reason why I have the same problem with a Hive recipe? no workarround possible?
