How to partition a non partitioned dataset using python
ash_m
Registered Posts: 2 ✭✭
I want to partition a non partitioned dataset . Re-dispatching is not working as i want to have distinct partition values from a column of non partitioned dataset .
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 DataikerHi,
@ash_m
Can you explain a bit more about, perhaps provide an example on how discrete partitions and redispatching redispath would not work for your use case?https://knowledge.dataiku.com/latest/mlops-o16n/partitioning/concept-redispatch.html
You can always add the partioned column back to the dataset if needed by using prepare recipe and https://doc.dataiku.com/dss/latest/preparation/processors/enrich-with-record-context.html