Does Dataiku have Set Operation such like UNION, INTERSECT in SQL?

p_phanwong
p_phanwong Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 7 ✭✭✭

I noticed this question when I was using a Stack recipe with uploaded dataset. The Stack recipe works like UNION in SQL but has only schema selecting option.

Is there anyway to use Set Operation on the uploaded dataset?

or we can only use SQL code recipe with database-dataset? (haven't try this yet)


Operating system used: Windows 10

Best Answer

  • fchataigner2
    fchataigner2 Dataiker Posts: 355 Dataiker
    Answer ✓

    Hi,

    an "intersect" would be done by a join, more precisely an inner join. You can do one on uploaded files datasets with a Join recipe. Note that the default join type in a join recipe is left outer join, so you have to change it in the modal of the join definition.

Setup Info
    Tags
      Help me…