FilterOnDateRange to SQL

Options
davidmakovoz
davidmakovoz Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Neuron 2023 Posts: 67 Neuron

I'm running a FilterOnDateRange preprocessing step and getting the following message:

Not supported settings for 'FilterOnDateRange' processor: Not translatable to SQL

I'm just curious, why isn't it translatable to sequel?

I can definitely use a where condition

where column_name > date1 and column_name < date2

What am I missing?

Best Answer

  • davidmakovoz
    davidmakovoz Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Neuron 2023 Posts: 67 Neuron
    Answer ✓
    Options

    Btw, I figured out a work-around this problem.

    I added a column with the number of days from the original date column till 'now', which can be done in-database. And then just applied the date range condition in terms of the number of days.

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Options

    Hi,

    Only a small subset of processors can be automatically translated to SQL by DSS. Translation for this particular processor is not currently implemented, so if you use this processor, the processing will happen locally instead of fully-in-database.

    We are regularly adding new processors and will make sure to take your request into account.

  • davidmakovoz
    davidmakovoz Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Neuron 2023 Posts: 67 Neuron
    Options

    I understand that it's not available. I was just a bit surprised that it wasn't implemented, seems like a pretty straightforward mapping from the filter to the SQL command, unless I'm missing something.

Setup Info
    Tags
      Help me…