Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

Sync empty Hive table

UserBird
Dataiker
Sync empty Hive table

I have a shell script which appends a Hive table (overwritten on every run of the workflow) to a Hive archive table. However, on occasion, the first Hive table is empty, which is breaking the workflow because I get an error when the shell script runs:




Failed to access source dataset project_key.dataset_name. Either it is empty or another error occured. Job cannot continue.


Is there a way around this?

0 Kudos
0 Replies

Labels

?
Labels (2)
A banner prompting to get Dataiku