How to Use placeholder while reading data from Hive table?
Hi,
In my use case, I want to read a table from the Hive through the query option and apply different filters on top of it and create a different dataset.
A typpical example would be like -
1. Select * from <table_name> where country = ? (1st dataset)
2. Select * from <table_name> where country = ? (2nd dataset)
Is there any way I can use a config file here and put the value of config file in this "?" placeholder
Any help would be appreciated!!
Answers
-
CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭
Hi, @sagar_dubey
! Can you provide any further details on the thread to assist users in helping you find a solution (insert examples like DSS version etc.) Also, can you let us know if you’ve tried any fixes already?This should lead to a quicker response from the community. -
Ignacio_Toledo Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 415 Neuron
Hi @sagar_dubey
,Have you investigated the use of partitions? or maybe create the datasets using a "split" visual recipe?
If you have, and they doesn't apply to your use case, could you provide more information as suggested by @CoreyS
?Cheers!