Left join of empty dataset
Tomas
Registered, Neuron 2022 Posts: 121 ✭✭✭✭✭
Hi,
I have a join recipe (left join) where one of the joined table is empty (it is calculated sucesfully but empty). The recipe fails with an ERROR that the input dataset is not ready. How to avoid this error?
Thanks
I have a join recipe (left join) where one of the joined table is empty (it is calculated sucesfully but empty). The recipe fails with an ERROR that the input dataset is not ready. How to avoid this error?
Thanks
Tagged:
Best Answer
-
Was it computed by Impala ? If it was, unfortunately, a behavior of Impala is that if there are 0 output rows, it doesn't even create an empty file, which leads DSS to think that the dataset isn't ready. There is no workaround apart from changing the engine which computed the empty dataset.
Answers
-
Yes it was.
-
Is it the same reason why I have the same problem with a Hive recipe? no workarround possible?