I have external (Spectrum) Redshift tables that I can preview and query using Dataiku. However, when using any of the built-in recipes (filter, data prep, etc.), I cannot output the dataset to S3 or Snowflake. I think this issue occurs because the data in the external table sits in S3, not Redshift. I don't have direct access to the S3 bucket, so I'm looking for another workaround to be able to pull data from external tables and land data in S3 and Snowflake.
Job failed: Input dataset is not ready (table does not exist)
Additional technical details
- Error code: ERR_JOB_INPUT_DATASET_NOT_READY_NO_TABLE
- Error type: com.dataiku.dip.exceptions.SourceDatasetNotReadyException
