Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
"Fold" processors in visual recipe - Implement In-Database engine
Added on October 4, 2024 8:14AM
Likes: 4
Replies: 0
aburkh
Registered Posts: 9 ✭✭✭✭
Today, fold processors require the DSS engine because they are not supported as in-database processing, which forces dataiku designers to implement SQL recipes to perform fold operations.
Most modern databases support "unpivot" syntax, which enable fold processors to be converted to SQL.
https://duckdb.org/docs/sql/statements/unpivot.html
https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-qry-select-unpivot.html
https://docs.snowflake.com/en/sql-reference/constructs/unpivot
Can you please implement in-database fold processors to improve the user experience?