How to Use placeholder while reading data from Hive table?

Options
sagar_dubey
sagar_dubey Partner, Registered Posts: 17 Partner

Hi,

In my use case, I want to read a table from the Hive through the query option and apply different filters on top of it and create a different dataset.

A typpical example would be like -

1. Select * from <table_name> where country = ? (1st dataset)

2. Select * from <table_name> where country = ? (2nd dataset)

Is there any way I can use a config file here and put the value of config file in this "?" placeholder

Any help would be appreciated!!

Answers

  • CoreyS
    CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭
    Options

    Hi, @sagar_dubey
    ! Can you provide any further details on the thread to assist users in helping you find a solution (insert examples like DSS version etc.) Also, can you let us know if you’ve tried any fixes already?This should lead to a quicker response from the community.

  • Ignacio_Toledo
    Ignacio_Toledo Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 411 Neuron
    Options

    Hi @sagar_dubey
    ,

    Have you investigated the use of partitions? or maybe create the datasets using a "split" visual recipe?

    If you have, and they doesn't apply to your use case, could you provide more information as suggested by @CoreyS
    ?

    Cheers!

Setup Info
    Tags
      Help me…