"Fold" processors in visual recipe - Implement In-Database engine

aburkh
aburkh Registered Posts: 9 ✭✭✭

Today, fold processors require the DSS engine because they are not supported as in-database processing, which forces dataiku designers to implement SQL recipes to perform fold operations.

Most modern databases support "unpivot" syntax, which enable fold processors to be converted to SQL.
https://duckdb.org/docs/sql/statements/unpivot.html
https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-qry-select-unpivot.html
https://docs.snowflake.com/en/sql-reference/constructs/unpivot

Can you please implement in-database fold processors to improve the user experience?

4
4 votes

In the Backlog · Last Updated

Thanks for the feedback, this has been logged internally and we will let you know if we move forward with development.

Setup Info
    Tags
      Help me…