I remove columns and the spark context stops

Caspar

I remove a three columns and I get the message that the sparks context stops while waiting for backend. At first I thought that the server is occupied. But this seems not to be the case. Other recipes run but this one again and again stops.

Dataiku version used: 14.7.2

Dataiku version used: 14.7.2

tgb417

@casper

Welcome to the Dataiku community.

I’m not at my Dataiku instance right now. However, from time to time I’ve seen situations like this. (I’m not clear if what I’m going to try to describe is available to you are not.)

go into the dataset before this recipe.

Go to settings.

In settings “test” the dataset.

Check and reset the schema if necessary

Close the dataset.

Rebuild the prior dataset from the prior recipient if necessary.

if you have build the dataset you are trying to build already. Then go to the dataset after your recipient. Do the same thing, test and check and reset the schema as necessary.

If none of those things work. I’d suggest opening a support ticket. The support team is very helpful.