Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
I am currently trying to use the concept of partitioning for one of my datasets, the idea being to be able to enrich it with a temporal dimension which is not present in the base.
I have well defined my file hierarchy and my pattern to find my partitions
I try to add a column to my dataset containing the date of the partition
But the problem is that once the recipe is launched, my output column is empty for some reason...
If anyone has an idea of what I'm missing, I'd love to hear it
Operating system used: Windows
As it is clearly stated in the doc, you have to use the DSS engine (local stream), I used to use the Spark Engine, now everything works fine !
As it is clearly stated in the doc, you have to use the DSS engine (local stream), I used to use the Spark Engine, now everything works fine !