Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Transformation on dataset at source
Added on March 30, 2020 12:43PM
Likes: 1
Replies: 1
piyushk
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Adv Designer, Registered Posts: 55 ✭✭✭✭✭
How can we transform a dataset at the source level from Dataiku? For example, I am extracting data from a table and would like to perform cleaning operations at the source level using the computation power of the source. Can we do it through DSS?
Best Answer
-
Hi, you can use DSS visual recipes to perform cleaning / wrangling operations, if properly configured they will leverage the underlying execution engines (SQL, Spark, Hive...)
https://academy.dataiku.com/latest/concepts/where-compute-happens.html
You can also use code recipes and queries and write your own scripts to manage data extraction and cleaning operations.
Hope this helps