How to remove partitioning?

Registered Posts: 41 ✭✭✭✭✭
One of my dataset is partitioned along two dimensions (source and date), but I'd like to retrieve a non-partitioned dataset from it. When I try to run a simple "Sync" recipe using "All available" partitions, the build fails systematically, probably because I don't have a source partition for each existing date. Is it possible to find a way around this?

Best Answer

  • Dataiker, Dataiku DSS Core Designer, Registered, Moderator Posts: 753 Dataiker
    Answer ✓
    Hi,

    A fairly ugly but efficient way of doing that is to define another dataset, non partitioned, pointing to the same location (table or file path). However, there won't be a link in the Flow for that.

Answers

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.