Do you know the History of Data Science? READ MORE

Append in redispatch partitioning dataset

Level 2
Append in redispatch partitioning dataset

Hi - Need help with understanding, how the append would work when redispatch partitioning a data set. 

My Scenario is – Data is partitioned on time dimension(monthly). The update is run every month and an extract is created for the past 3 months. Ideally what I want is, if N is my current month, N-1 would be a new partition, and (N-2, N-3) that are already existing, are rebuilt with new data. I also need the already exiting data to remain for the past months(N-4, N-5, N-T).

My question is would the above scenario be played out on checking the append option, if not what would be the best achieve this?


0 Kudos
0 Replies
Labels (1)
A banner prompting to get Dataiku DSS