New to Dataiku DSS? Try out our NEW Quick Start Programs today and get onboarded on the product in just one hour! Let's go

dispite the recipe have results, the ouput is empty

Solved!
HugoDupeux
Level 1
dispite the recipe have results, the ouput is empty

Hi everybody,

I'm having trouble with one of my recipe. A simple one. I just filter some rows and drop some of useless columns and everything looks great on the visualization. On my sample of 10000 rows (first records), I loose 374 records. recipe.png

My problem is, when I run this recipe, the ouput have 0 rows. I try re-run mutliple time (force rebuild, smart reconstruction), copy the recipe to have a different outpu, clear the output data, close and re-open dataiku... but same problem every time.

output.pngIf I disable the "filter with formula", the output data actually have rows... But if my filter is deleting all rows, I should see that inside the recipe preparation, isn't it ? Moreover, I see rows who satisfy the filter so...

If any of you have any ideas, I would be thankfull.

 

 

0 Kudos
1 Solution
Clément_Stenac
Dataiker
Dataiker

Hi,

Please try switching to DSS engine to execute this recipe (I'm guessing you're using Spark)

View solution in original post

0 Kudos
2 Replies
Clément_Stenac
Dataiker
Dataiker

Hi,

Please try switching to DSS engine to execute this recipe (I'm guessing you're using Spark)

View solution in original post

0 Kudos
HugoDupeux
Level 1
Author

Hi Clément,

Thanks for your answers.

I am using Spark engine. I try in local and... it failed, after of lot time of computing. But, during this, I drop a bunch of columns to keep the writing output as fast as possible. In addition, I see warning during the computation, a mismatch between the detected type and some rows. I change this in the initial dataset.

And now it works with Spark engine.

Thanks fou your help. I hadn't though changing the engine to debug.

0 Kudos
A banner prompting to get Dataiku DSS