How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?

Highlighted
UserBird Dataiker
Dataiker
How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?
Jump to solution
I have an hdfs dataset which has been created and synced from an oracle table. How can I sync it incrementally every month? I want to schedule a job for this.
0 Kudos
1 Solution

Accepted Solutions
jrouquie Dataiker
Dataiker
Re: How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?
Jump to solution
This is a typical use case for partitioning, see

http://doc.dataiku.com/dss/latest/partitions/index.html

(and be prepared for the steep learning curve 😉

View solution in original post

0 Kudos
1 Reply
jrouquie Dataiker
Dataiker
Re: How to schedule a job to incrementally append data to an hdfs dataset from an oracle table ?
Jump to solution
This is a typical use case for partitioning, see

http://doc.dataiku.com/dss/latest/partitions/index.html

(and be prepared for the steep learning curve 😉

View solution in original post

0 Kudos
Labels (2)