Using Variable to Select Partition in Visual Recipe

[khairulfathi]

Hi there,

Is there a way to use variable when selecting partition in visual recipe input? I have no issue when using the variable value. I have couple of input tables to process with same partition dimension and value.

Thank you.

[SarinaS · Accepted solution]

Hi @khairulfathi ,

The option to select "expand variables" for the "Explicit values" partition dependency function is available as of 8.0.3. 

Thanks,

Sarina 

[khairulfathi]

Thanks @SarinaS . I guess I'm using older version then. Any workaround solution that you can recommend? My data sources are Hive and target will be HDFS. Only source is partitioned. 

[SarinaS]

Hi @khairulfathi ,

Were you able to upgrade? Depending on your current version of DSS, here are the paths you might consider for upgrading.

You might also check out DSS 8.0.5.  

I'm not sure what version of DSS you are currently on, but if you are unable to upgrade you might utilize available variable expansion in Hive queries.  

Thanks,

Sarina