Missing data in parsed date column

Aminmin
Level 3
Missing data in parsed date column

hi, i uploaded a file that has a date column in YYYY-MM-DD with meaning as date(unparsed). I parsed the column and now has a YYYY-MM-DD followed by timezone. When i run the script, the output file has missing dates from both date and parsed_date columns. Datatype was also changed.

Pls help to identify what steps i may have missed. 

Again, if i change datatype to date and left the date(unparsed), i run successfully with warning and again the data disappeared.

Pls help. I thank you in advance


Operating system used: Windows10

0 Kudos
2 Replies
AlexT
Dataiker

Hi,

Can you confirm what dataset type(SQL, Cloud Storage, etc) you have? 

Are you using append mode?

Can you try to clear the datasets and try building the output dataset (forced recursive build) to ensure all datasets upstream are fully built as well? 

Thanks,

 

0 Kudos
Aminmin
Level 3
Author

Dear AlexT, thank you for your kind advise.

I managed to resolve the issue by letting the datatype be string.

 

Regards

 

0 Kudos

Labels

?
Labels (1)

Setup info

?
A banner prompting to get Dataiku