Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
hi, i uploaded a file that has a date column in YYYY-MM-DD with meaning as date(unparsed). I parsed the column and now has a YYYY-MM-DD followed by timezone. When i run the script, the output file has missing dates from both date and parsed_date columns. Datatype was also changed.
Pls help to identify what steps i may have missed.
Again, if i change datatype to date and left the date(unparsed), i run successfully with warning and again the data disappeared.
Pls help. I thank you in advance
Operating system used: Windows10
Can you confirm what dataset type(SQL, Cloud Storage, etc) you have?
Are you using append mode?
Can you try to clear the datasets and try building the output dataset (forced recursive build) to ensure all datasets upstream are fully built as well?