Multi-column fold on Google BigQuery?

Options
TrevorHall
TrevorHall Registered Posts: 15 ✭✭✭✭
in Using Dataiku

Trying to execute a recipe with a multi-column fold on a Google BigQuery table gives the following error:

In-database (SQL)
You cannot use this engine:
Not supported settings for 'MultiColumnFold'
processor: Not translatable to SQL

Non-selectable
Local stream Output dataset is in Google BigQuery

Any suggestions for moving forward?

· Share on FacebookShare on Twitter

Answers

  • KimmyC
    KimmyC Dataiker Posts: 34 Dataiker
    Options

    Hi,

    This error indicates that you cannot use this particular processor in this prepare recipe. The reason being that when DSS can only write SQL to Bigquery and the "Fold multiple columns" processor has settings that makes it impossible to translate to SQL.

    If you really need to implement this processor, then you will have to go through GCS instead.

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…