Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

writing to partition in R

MNOP
Level 3
writing to partition in R

Hi, 
I'm writing to the dataset as follows 

 

dkuWriteDataset(model.df,"MasterDataADS")


How do we partition the data based on the column "Market"? 
Similarly, how to read a particular partition of the data in R and Python?

 

0 Kudos
1 Reply
AlexT
Dataiker

Hi @MNOP ,
You can specify the partition :
https://doc.dataiku.com/dss/api/12/R/dataiku/reference/dkuWriteDataset.html

dkuWriteDataset(df, name, partition = "", schema = TRUE,
convertLists = TRUE)
Note if you are running as part of recipe in the flow it should inherit whatever partition is defined in the job running you only need to specify it when in R notebook or if you are ignoring the flow and writing to other partitions 

0 Kudos