Community Conundrum 27: Stacks of Questions is live! Read More

How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?

Dataiker
Dataiker
How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?
I have an hdfs dataset which has been created and synced from an oracle table. How can I sync it incrementally every month? I want to schedule a job for this.
0 Kudos
1 Reply
Dataiker Alumni
This is a typical use case for partitioning, see

http://doc.dataiku.com/dss/latest/partitions/index.html

(and be prepared for the steep learning curve 😉
0 Kudos
Labels (2)