The February release for the Community is live! Read More

Using Variable to Select Partition in Visual Recipe

Solved!
khairulfathi
Level 1
Using Variable to Select Partition in Visual Recipe

Hi there,

Is there a way to use variable when selecting partition in visual recipe input? I have no issue when using the variable value. I have couple of input tables to process with same partition dimension and value.

Thank you.

partition variable.JPG

0 Kudos
1 Solution
SarinaS
Dataiker
Dataiker

Hi @khairulfathi ,

The option to select "expand variables" for the "Explicit values" partition dependency function is available as of 8.0.3. 

Screen Shot 2021-02-12 at 5.09.03 PM.png

Thanks,

Sarina 

 

View solution in original post

0 Kudos
3 Replies
SarinaS
Dataiker
Dataiker

Hi @khairulfathi ,

The option to select "expand variables" for the "Explicit values" partition dependency function is available as of 8.0.3. 

Screen Shot 2021-02-12 at 5.09.03 PM.png

Thanks,

Sarina 

 

View solution in original post

0 Kudos
khairulfathi
Level 1
Author

Thanks @SarinaS . I guess I'm using older version then. Any workaround solution that you can recommend? My data sources are Hive and target will be HDFS. Only source is partitioned. 

0 Kudos
SarinaS
Dataiker
Dataiker

Hi @khairulfathi ,

Were you able to upgrade? Depending on your current version of DSS, here are the paths you might consider for upgrading.

You might also check out DSS 8.0.5.  

I'm not sure what version of DSS you are currently on, but if you are unable to upgrade you might utilize available variable expansion in Hive queries.  

Thanks,

Sarina

0 Kudos
A banner prompting to get Dataiku DSS