Random proxies with Selenium Python

We're an insurance company from to Santiago of Chile. We need to scrape a website and pull prices of our competitors using dummy data as an input. We are mainly interested in the code algorithm of a scraper but under certain conditions. This should be done with Python+Selenium with random proxies and random agents, this is to avoid banning our bots.

We have a code Jupyter-Notebook to scrape the website but without random proxies-agents, we are attaching the code as a file. The main goal is to create a Python-Selenium algorithm (3.8 version or upper, and we're working with jupyter-notebook) under Chrome or Mozilla browser, furthermore is very important to use random proxies (public proxies desirably), random agents and this should be working for every requests on the website without bans or failures (bans for ip, bans for requesting many times the same customer id, etc...). The process starts in "[login to view URL]", you should click the button "Cotiza Aquí" and will load a page of customer information (this could be a dummy input), after providing this information you would get to prices of all competitors, you should save these prices like an object in Python.

We offer $$$$ US for who is interested in this project and meet the profile, the needed skills are:

- Python + Selenium for scraper websites

- Knowledge about the parameters proxies and agent in Selenium


• If accepted, the above project shall be undertaken under the utmost confidentiality, both as regards its results and the dummy data provided therein.

• Without prejudice to above, if selected, you shall be required to enter into a binding NDA and a Data Processing Agreement under terms satisfactory to the Company.

• The project is to be carried out within the limits set forth under applicable regulation and your commitment to comply with all applicable regulation is expected.

Taidot: Python, Tietojen kaavinta verkosta, Selenium Webdriver

Näytä lisää: selenium change ip address python, selenium open with proxy, python selenium webdriver with proxy, selenium proxy authentication python, how to set proxy in firefox using selenium webdriver python, selenium python proxy not working, selenium proxy python chrome, rotating proxies selenium python, testsuite example selenium python, test suites selenium python, selenium python test suite example, selenium python load database, selenium python test suite, create test suite selenium python, selenium python examples, selenium python script will run ie9, web scraping script using selenium python, selenium python, selenium python api, selenium python freelance

Tietoa työnantajasta:
( 0 arvostelua ) Santiago, Chile

Projektin tunnus: #27966298

Myönnetty käyttäjälle:


Hi there, I have good experience in python with selenium and also have good experience in proxy handling. Message me and lets take this forward. Thanks

$240 USD 1 päivässä
(13 Arvostelua)

10 freelancers are bidding on average $175 for this job

(211 arvostelua)

Hi there, Let’s have a quick chat to discuss this project. I am expert in Python, PHP, JavaScript,Web Scraping,MYSQL.I do have expertise for this project. You can check my portfolio here:- https://www.freelancer.com/u Lisää

$200 USD 2 päivässä
(27 arvostelua)

***Will comply All applicable regulation.*** Hello, I have very deep experience in web scraping(using python, php, c.. All confident) I have ever scraped website's data using selenium or mechanizm with beautifulsoup s Lisää

$250 USD 1 päivässä
(19 arvostelua)

Hello ⭐ I can do it you hope in your timeline. ⭐ I have checked the requirements in job description I have many experience with Python and Perl.I can do scraping captcha [login to view URL](selienium,crawler,beautifulsou Lisää

$140 USD 7 päivässä
(4 arvostelua)

Hello,Nice to meet you I have just read your description carefully I am an expert in Python selenium and I have ever used random proxies for scraping age So i can help you wiht my experience and skill in a short time p Lisää

$140 USD 7 päivässä
(5 arvostelua)

Hi I had gone through description and notebook. I had solved the same hurdle u are facing for another client in US. For that I used HMA proxy and configured it to change every minute. Thus I was able to get it running Lisää

$50 USD 3 päivässä
(4 arvostelua)

Hi there, I would love to work on your project with the strong skills needed for the project. However I have to clarify few more questions which can be discussed to get scope locked. Please initiate chat to move fur Lisää

$140 USD 7 päivässä
(0 arvostelua)

I have already build similar types of scrapping bot , I have more than 3 years of experience in scrapping , I can do it in max 7 days. I have experience in selenium , scrappy, beautiful soup and many more scrapping m Lisää

$278 USD 7 päivässä
(0 arvostelua)

Hi there I use python with selenium on a daily basis doing pretty much exactly what you require. I would use browser profiles to set user agents and proxies would be scraped from a public site as the bot runs. I do als Lisää

$167 USD 5 päivässä
(0 arvostelua)