Join us on July 16th as we explore real-world Reinforcement Learning Learn more

Issue: Non-matching partitioning scheme for <Table Name>. R recipe

Level 1
Issue: Non-matching partitioning scheme for <Table Name>. R recipe

Hi Experts,

I have a R recipe and I am writing to data frames (which are hive tables) using below function.

dkuWriteDataset(df1,"Hive Table A") - for this I want partition pattern as %Y/%M/%D/.*

Partition_pattern_A.jpg

 dkuWriteDataset(df2,"Hive Table B") - for this I want partition pattern as %Y/%M/%D/%H/.*

Partition_pattern_B.jpg

 but while running recipe it gives me error: Non-matching partitioning scheme for Hive Table B.

However, if I keep partition pattern same for both the tables ( %Y/%M/%D/.*) then there is no issue.

Also, I would like to know how can I create partition for every run?

 

0 Kudos
0 Replies
Labels (1)