Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hi, I'm trying to read a delta table as a source for my initial dataset. A delta table is comprised of a bunch of partitioned and compressed parquet files along with a /_delta_log/ folder which contains acid history.
I did read this article - https://doc.dataiku.com/dss/9.0/connecting/formats/deltalake.html but it didn't actually show how to set up that process. I was curious if anyone had experience doing this before. The files for the Delta Table are stored in s3 and I am able to connect to s3 bucket + folder just fine.
Thanks,
Arnav Chaudhary