I remove columns and the spark context stops
I remove a three columns and I get the message that the sparks context stops while waiting for backend. At first I thought that the server is occupied. But this seems not to be the case. Other recipes run but this one again and again stops.
Dataiku version used: 14.7.2
Dataiku version used: 14.7.2
Answers
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,649 NeuronWelcome to the Dataiku community.
I’m not at my Dataiku instance right now. However, from time to time I’ve seen situations like this. (I’m not clear if what I’m going to try to describe is available to you are not.)
go into the dataset before this recipe.Go to settings.
In settings “test” the dataset.
Check and reset the schema if necessary
Close the dataset.
Rebuild the prior dataset from the prior recipient if necessary.
if you have build the dataset you are trying to build already. Then go to the dataset after your recipient. Do the same thing, test and check and reset the schema as necessary.If none of those things work. I’d suggest opening a support ticket. The support team is very helpful.