Missing data in parsed date column
hi, i uploaded a file that has a date column in YYYY-MM-DD with meaning as date(unparsed). I parsed the column and now has a YYYY-MM-DD followed by timezone. When i run the script, the output file has missing dates from both date and parsed_date columns. Datatype was also changed.
Pls help to identify what steps i may have missed.
Again, if i change datatype to date and left the date(unparsed), i run successfully with warning and again the data disappeared.
Pls help. I thank you in advance
Operating system used: Windows10
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,237 Dataiker
Hi,
Can you confirm what dataset type(SQL, Cloud Storage, etc) you have?
Are you using append mode?
Can you try to clear the datasets and try building the output dataset (forced recursive build) to ensure all datasets upstream are fully built as well?
Thanks,
-
Dear AlexT, thank you for your kind advise.
I managed to resolve the issue by letting the datatype be string.
Regards