SQLExecutor2 through Webapp usage

tamvap
tamvap Dataiku DSS Core Designer, Registered Posts: 10 ✭✭✭✭
edited July 16 in Using Dataiku

Hello,

Currently I am trying to use SQLExecutor2 to a DSS Webapp. The reason why is that I have a large dataset and i want to get the data filtered.

First I was trying to use an existing Dataset that has been created in DSS Flow from SQL table like below.

mydataset = dataiku.Dataset("VALUE_TAB")
executor = SQLExecutor2(dataset=mydataset)

test_query = """SELECT * FROM VALUE_TAB WHERE VERSION = 'V3'"""
result = executor.query_to_df(test_query)

I had an error message that says that:

"Could not find table/view VALUE_TAB in schema SCHEMA".

Is there a way to use in a Webapp a dataset from DSS flow with SQLExecutor2 library , or i have to make the connection directly with the SQL?

Thanks,

Tamvap

Answers

  • fchataigner2
    fchataigner2 Dataiker Posts: 355 Dataiker

    Hi,

    the SQLExecutor2 only issue statements on a jdbc connection corresponding to the dataset you pass, here the VALUE_TAB dataset. But that doesn't mean that you can put the dataset name in a SQL query and have DSS adjust the query automatically to replace VALUE_TAB by the actual schema/table name that the dataset points to.

    It's likely that here you need to get the schema and table name from the dataset and put them in the SELECT * FROM ... , with proper quoting.

Setup Info
    Tags
      Help me…