Using Variable to Select Partition in Visual Recipe
Hi there,
Is there a way to use variable when selecting partition in visual recipe input? I have no issue when using the variable value. I have couple of input tables to process with same partition dimension and value.
Thank you.
Best Answer
-
Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 317 DataikerHi @khairulfathi
,The option to select "expand variables" for the "Explicit values" partition dependency function is available as of 8.0.3.
Thanks,
Sarina
Answers
-
Thanks @SarinaS
. I guess I'm using older version then. Any workaround solution that you can recommend? My data sources are Hive and target will be HDFS. Only source is partitioned. -
Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 317 Dataiker
Hi @khairulfathi
,Were you able to upgrade? Depending on your current version of DSS, here are the paths you might consider for upgrading.
You might also check out DSS 8.0.5.
I'm not sure what version of DSS you are currently on, but if you are unable to upgrade you might utilize available variable expansion in Hive queries.
Thanks,
Sarina