Dataset Left Anti Join - issue with decimals

Solved!
unkxowx
Level 2
Dataset Left Anti Join - issue with decimals

Hi all, 

I have two datasets that are similar in their structure and my goal is to get a dataset that has records of the left table that do not have a match in the right table and as a result, I used Left Anti Join.

I am matching the tables on a number of keys and one of those keys is a column which is of type decimal double in both the datasets, but the format is a little bit different, as in, Dataset_1 has values like 1.20, 2.45 etc. and on the other hand Dataset_2 has values like 1.20000, 2.45000 etc.

I tried formatting them to reach an equivalent number of digits after decimal using format, substring etc. etc. but failed to achieve the desired results (gives me records in the left table that do have a match in the right table but that particular key varies by just a few trailing 0s. I feel this is causing an issue with the joining because when I tried joining them in PBI after changing the decimal format to an equal number of digits, I was able to join and get the dataset that I wanted.

I am kind of baffled as to how and why this is happening. Any solutions?

Thank you 🙂

0 Kudos
1 Solution

Please mark the thread as accepted solution, thanks!

View solution in original post

0 Kudos
5 Replies
Turribeach

I can't reproduce your issue (see screen shots below). What version of Dataiku are you using? Where are the datasets stored on?

 

Screenshot 2024-01-25 at 21.20.11.pngScreenshot 2024-01-25 at 21.20.17.pngScreenshot 2024-01-25 at 21.20.29.pngScreenshot 2024-01-25 at 21.20.40.png

0 Kudos
unkxowx
Level 2
Author

datasets are csv stored files

and Version: 12.2.3

0 Kudos

Well try upgrading to 12.5 since I can’t reproduce it. Also where are the datasets stored on?

0 Kudos
unkxowx
Level 2
Author

I updated and it works haha. thank you 🙂

0 Kudos

Please mark the thread as accepted solution, thanks!

0 Kudos