Filter recipe : How to avoid stop processing when there are no matched records

databirds11 Registered Posts: 2

Hi dataiku users,

I want to know how to resolve the situation in subject.

I use filter recipe only for processing the exception data, and stack with main data after that, so if there are no filtered records in output dataset, no problem.

but in dataiku, if there are not all data sets in stack recipe, return error and stop processing in that time.

Do you know how to ?

Best Answer

  • databirds11
    databirds11 Registered Posts: 2
    Answer ✓

    I could avoid error by changing engine of filter recipe, "Spark" to "DSS".
    It seems DSS engine allow to create 0 record dataset, but Spark engine is not.


Setup Info
      Help me…