Submit your inspiring success story or innovative use case to the 2022 Dataiku Frontrunner Awards! ENTER YOUR SUBMISSION

Spark delta lake write support and structured streaming to delta tables

0 Kudos

Delta lake is an open format thats already supported on open source spark, we would like to be able to write delta tables directly from dataiku with spark recipes.

This would enable more ETL use cases,  and with spark structured streaming with delta tables better management of streaming data.