Webscraping with Dataiku
Hello, everybody! I have a working program in Python that I use to go through switch devices online, and it returns a CSV with all the information I need to perform an analysis. I tried to transfer the code from a server I was using to run this program to Dataiku, but I encountered an error while running pyautogui (which I solved by switching the library to keyboard). I also got an error when I tried to run a command in Selenium (Error in Python process: At line 81: <class 'AttributeError'>: 'Service' object has no attribute 'process'). Does anybody know why this happens?
Operating system used: Windows
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,171 NeuronYou most likely need to setup a Python code environment to install all the required packages that your code needs.
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,237 DataikerThe actual AttributeError you are seeing looks similar to: https://stackoverflow.com/questions/37004635/python-selenium-exception-attributeerror-service-object-has-no-attribute-pr
You will need to make sure that chrome/ chromedriver are download the path is defined.
https://community.dataiku.com/discussion/comment/40200#Comment_40200 -
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,605 NeuronInstalling Selenium to use in Dataiku can be done. However, it can be a bit complicated if I remember correctly.
Here is an older thread on the topic.