How do I specify partitions?

Solved!
UserBird
Dataiker
How do I specify partitions?
 
0 Kudos
1 Solution
jrouquie
Dataiker Alumni

There are two places where you specify partitions in a recipe:




  • when running the recipe, you need to tell DSS wich partitions of the output dataset you want to build. For instance โ€œ1789-07-14/1789-07-23โ€ would ask DSS to build ten consecutive partitions (pertaining to a long time ago).

  • when defining the recipe, you need to specify โ€œpartition dependenciesโ€. Whenever DSS wants to build a partition of the output, it needs to know which partition of the input dataset are to be used. There are many ways to specify a dependency, for instance โ€œfrom two days before to 0 days beforeโ€, in which case to build the output partition 1789-07-20 DSS would use the input partitions 1789-07-18 to 1789-07-20.



See also http://doc.dataiku.com/dss/latest/partitions/identifiers.html

View solution in original post

0 Kudos
1 Reply
jrouquie
Dataiker Alumni

There are two places where you specify partitions in a recipe:




  • when running the recipe, you need to tell DSS wich partitions of the output dataset you want to build. For instance โ€œ1789-07-14/1789-07-23โ€ would ask DSS to build ten consecutive partitions (pertaining to a long time ago).

  • when defining the recipe, you need to specify โ€œpartition dependenciesโ€. Whenever DSS wants to build a partition of the output, it needs to know which partition of the input dataset are to be used. There are many ways to specify a dependency, for instance โ€œfrom two days before to 0 days beforeโ€, in which case to build the output partition 1789-07-20 DSS would use the input partitions 1789-07-18 to 1789-07-20.



See also http://doc.dataiku.com/dss/latest/partitions/identifiers.html

0 Kudos