Hi, I'm trying to read a delta table as a source for my initial dataset. A delta table is comprised of a bunch of partitioned and compressed parquet files along with a /_delta_log/ folder which contains acid history.
I did read this article - https://doc.dataiku.com/dss/9.0/connecting/formats/deltalake.html but it didn't actually show how to set up that process. I was curious if anyone had experience doing this before. The files for the Delta Table are stored in s3 and I am able to connect to s3 bucket + folder just fine.