BigQuery inequality join

Options
UgoD
UgoD Registered Posts: 9 ✭✭✭

Hi,

I'm using Dataiku 10 with bigquery and Python 3.6.

Lately, I was trying to join tables using a threshold of one table on proba from another.

But I got this error

Join is only supported with equality on BigQuery.

which is a quite understandable error.

But it's actually possible to join with >= on BigQuery with something like that .

So I wonder if there is another issue I do not have in mind or if it's possible to update the join visual recipe to match this behavior.

Thanks !

Best regards

Ugo


Operating system used: Windows 10

Answers

  • gnaldi62
    gnaldi62 Partner, L2 Designer, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Frontrunner 2022 Participant, Neuron 2023 Posts: 79 Neuron
    Options

    Hi Ugo,

    which version of the BQ JDBC driver are you using ? which join ? on which type of fields are you putting conditions ? We also did find some issues with outer/left/right join in the past (so we needed to use a cross join and filter results later on) and also with DATE fields, but with more recent versions of the drivers we have been able to apply more sophisticated join conditions like the ones you indicated.

    Rgds.

    Giuseppe

Setup Info
    Tags
      Help me…