Weird behavior in Datetime

I am reading an excel file (.xlsx) which contains a column with Date and time value stored in custom (mmm d, yyyy h:mm:ss AM/PM). While uploading file to Dataiku is automatically reduces one second in the value. It is not done for each row but for on a random basis.
E.g. Input Value - Jan 31,2025 10:00:00 AM
Dataiku read it as -Jan 31,2025 9:59:59 AM
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,283 Dataiker
Hi,
Could you please open a support ticket and share a sample file so you can reproduce this so we can review it further?
One quick test would be to see if you can reproduce the issue by exporting to CSV from Excel and using the CSV in DSS.
Thanks -
Jurre Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered, Dataiku DSS Developer, Neuron 2022 Posts: 116 ✭✭✭✭✭✭✭
Possibly some microsecond-rounding involved in the sheet ? If the original date-value is a timestamp in milliseconds the custom formatting does some masking but the original value remains. I would add a temporary column in the Excelfile (together with conditional formatting) to check that.