"Connection Refused" when querying value via Pandas on Spark

Options
Rushil09
Rushil09 Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Frontrunner 2022 Participant Posts: 17 Partner

HI,

When I try to find a value via pandas on spark, I get some error saying Connection refused.

Here the size of the data is 24lakh rows. Plus when I run on pandas or core pyspark it works fine.

Can someone help?


Operating system used: Ubuntu

(Topic title edited by moderator to be more descriptive. Original title "Spark")

Tagged:

Answers

Setup Info
    Tags
      Help me…