Dataiku remove duplicate data

Chandrima

Hi all in dataiku after doing a left join operation I am removing all the duplicate values, but when I exported the dataset as an excel I noticed there are few rows which are exactly matching but are not removed or considered duplicate. Once I did the TRIM operation in excel then duplicate values were considered and removed. How can we tackle this in dataiku.

Turribeach

Use a Prepare recipe with the Transform String processor and change the mode to "Remove leading/trailing white spaces".

Chandrima

https://community.dataiku.com/discussion/comment/45657#Comment_45657

Can you please explain a little bit more?

Turribeach

Follow the steps shown on this documentation page:

https://knowledge.dataiku.com/latest/data-preparation/prepare-recipe/concept-prepare-recipe.html#using-the-processor-library

 Use the Transform String processor and change the mode to "Remove leading/trailing white spaces".