Issue with input as External (Spectrum) Redshift tables and output to S3 and Snowflake

kbutler27
kbutler27 Registered Posts: 1 ✭✭✭

I have external (Spectrum) Redshift tables that I can preview and query using Dataiku. However, when using any of the built-in recipes (filter, data prep, etc.), I cannot output the dataset to S3 or Snowflake. I think this issue occurs because the data in the external table sits in S3, not Redshift. I don't have direct access to the S3 bucket, so I'm looking for another workaround to be able to pull data from external tables and land data in S3 and Snowflake.

Job failed: Input dataset is not ready (table does not exist)

Additional technical details

  • Error code: ERR_JOB_INPUT_DATASET_NOT_READY_NO_TABLE
  • Error type: com.dataiku.dip.exceptions.SourceDatasetNotReadyException

Answers

Setup Info
    Tags
      Help me…