writing to partition in R
Mohammed
Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Registered Posts: 43 ✭✭✭
Hi,
I'm writing to the dataset as follows
dkuWriteDataset(model.df,"MasterDataADS")
How do we partition the data based on the column "Market"?
Similarly, how to read a particular partition of the data in R and Python?
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 DataikerHi @MNOP
,
You can specify the partition :
https://doc.dataiku.com/dss/api/12/R/dataiku/reference/dkuWriteDataset.htmldkuWriteDataset(df, name, partition = "", schema = TRUE,
convertLists = TRUE)
Note if you are running as part of recipe in the flow it should inherit whatever partition is defined in the job running you only need to specify it when in R notebook or if you are ignoring the flow and writing to other partitions