Webscraping with Dataiku

Bernardo

Hello, everybody! I have a working program in Python that I use to go through switch devices online, and it returns a CSV with all the information I need to perform an analysis. I tried to transfer the code from a server I was using to run this program to Dataiku, but I encountered an error while running pyautogui (which I solved by switching the library to keyboard). I also got an error when I tried to run a command in Selenium (Error in Python process: At line 81: <class 'AttributeError'>: 'Service' object has no attribute 'process'). Does anybody know why this happens?

Operating system used: Windows

Turribeach

You most likely need to setup a Python code environment to install all the required packages that your code needs.

https://knowledge.dataiku.com/latest/code/work-environment/concept-code-environments.html

Alexandru

The actual AttributeError you are seeing looks similar to: https://stackoverflow.com/questions/37004635/python-selenium-exception-attributeerror-service-object-has-no-attribute-pr

You will need to make sure that chrome/ chromedriver are download the path is defined.
https://community.dataiku.com/discussion/comment/40200#Comment_40200

tgb417

Installing Selenium to use in Dataiku can be done. However, it can be a bit complicated if I remember correctly.
Here is an older thread on the topic.

https://community.dataiku.com/discussion/30147/using-selenium-chrome-driver-in-python-recipe

https://community.dataiku.com/discussion/19661/using-selenium-with-a-python-recipe

https://community.dataiku.com/discussion/5317/use-selenium-through-jupyter