"Fold" processors in visual recipe - Implement In-Database engine
aburkh
Registered Posts: 8 ✭✭✭
Today, fold processors require the DSS engine because they are not supported as in-database processing, which forces dataiku designers to implement SQL recipes to perform fold operations.
Most modern databases support "unpivot" syntax, which enable fold processors to be converted to SQL.
https://duckdb.org/docs/sql/statements/unpivot.html
https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-qry-select-unpivot.html
https://docs.snowflake.com/en/sql-reference/constructs/unpivot
Can you please implement in-database fold processors to improve the user experience?
Tagged: