Using Variable to Select Partition in Visual Recipe

khairulfathi
khairulfathi Registered Posts: 11 ✭✭✭✭
in General

Hi there,

Is there a way to use variable when selecting partition in visual recipe input? I have no issue when using the variable value. I have couple of input tables to process with same partition dimension and value.

Thank you.

partition variable.JPG

· Share on Facebook

Best Answer

  • Sarina
    Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered, Moderator Posts: 321 Dataiker
    Answer ✓

    Hi @khairulfathi
    ,

    The option to select "expand variables" for the "Explicit values" partition dependency function is available as of 8.0.3.

    Screen Shot 2021-02-12 at 5.09.03 PM.png

    Thanks,

    Sarina 

    · Share on Facebook

Answers

  • khairulfathi
    khairulfathi Registered Posts: 11 ✭✭✭✭

    Thanks @SarinaS
    . I guess I'm using older version then. Any workaround solution that you can recommend? My data sources are Hive and target will be HDFS. Only source is partitioned.

    · Share on Facebook
  • Sarina
    Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered, Moderator Posts: 321 Dataiker

    Hi @khairulfathi
    ,

    Were you able to upgrade? Depending on your current version of DSS, here are the paths you might consider for upgrading.

    You might also check out DSS 8.0.5.

    I'm not sure what version of DSS you are currently on, but if you are unable to upgrade you might utilize available variable expansion in Hive queries.

    Thanks,

    Sarina

    · Share on Facebook
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…