Filter recipe and code recipe are not returning data to output dataset

CD
CD Registered Posts: 5 ✭✭✭✭

As the title says. We have an input dataset where we can sort correctly data inside the visual dataset. However, when we want to do a filter recipe, and even a SparkSQL recipe to filter data, it just creates an empty dataset with the correct headers.

Any idea why this is happening?

Best Answer

  • CD
    CD Registered Posts: 5 ✭✭✭✭
    Answer ✓

    I solved it.

    The user didn't have partitions and the dataset was too big to process and even though the job was "completed" it failed.

Answers

Setup Info
    Tags
      Help me…