I have a partitionned folder and I need to python recipe to create the associated partitionned dataset.
In the notebook, I can use the following code :
files = dataiku.Folder("xxxx")
files_info = files.get_info()
#chemin des fichiers
for itemName in paths:
with files.get_download_stream(itemName) as j:
# Write recipe outputs
measurement = dataiku.Dataset("Measurement")
But, when back in the recipe, the partitions are managed by DSS.
I also need to remove files.list_paths_in_partition() and for itemName in paths.
How can I load the right file in files.get_download_stream(itemName) ???
Thanks a lot