Why my partitionning date column is empty?
Options
Dmh911
Registered Posts: 3 ✭
I am currently trying to use the concept of partitioning for one of my datasets, the idea being to be able to enrich it with a temporal dimension which is not present in the base.
I have well defined my file hierarchy and my pattern to find my partitions
I try to add a column to my dataset containing the date of the partition
But the problem is that once the recipe is launched, my output column is empty for some reason...
If anyone has an idea of what I'm missing, I'd love to hear it
Operating system used: Windows
Best Answer
-
As it is clearly stated in the doc, you have to use the DSS engine (local stream), I used to use the Spark Engine, now everything works fine !