Sync empty Hive table

Options
UserBird
UserBird Dataiker, Alpha Tester Posts: 535 Dataiker
edited July 16 in Using Dataiku

I have a shell script which appends a Hive table (overwritten on every run of the workflow) to a Hive archive table. However, on occasion, the first Hive table is empty, which is breaking the workflow because I get an error when the shell script runs:


Failed to access source dataset project_key.dataset_name. Either it is empty or another error occured. Job cannot continue.

Is there a way around this?

Tagged:
Setup Info
    Tags
      Help me…