Crawling/Scraping Engineer

We're looking for a scraping/crawling engineer to join full time our 3-people Crawling team for a 3-month period.

This team is responsible for extracting information from thousands of websites every day. Due to constant changes in some of these websites, a number of our extractors break every day, so we need to continuously adapt them. We also need to continuously create new extractors for new sources.

Our tech stack: scrapy + Selenium. We use JIRA for the management of tasks.


- fluency in English, both written and spoken

- scraping/crawling experience (3+ years) using scrapy + Selenium

- python programming experience

- experience with online services, such as AWS and Cloudera

Please apply only in case you're an individual (i.e. no agencies) interested in joining the team full time for the next 3 months. Links to GitHub projects that you've developed in the past and any other references will be much appreciated.

A technical interview will be conducted before awarding the job.

Taidot: tiedonlouhinta, Java, Python, tietojärjestelmäarkkitehtuuri, Tietojen kaavinta verkosta

Näytä lisää: web crawling techniques, scrapy, web crawler tutorial, web scraping, web crawler tool, job scraping tools, web crawler python, web crawler, google job online data entry, job online php developer prado, getting job online live chat agent, engineer job sweden spanish, apply for a job online, system engineer job online, apply for job online graphic design, apply for job online in dubai for graphic designer, apply job online for graphic designer, apply typing job online, engineer freelance job online, find job online for web scraping

Tietoa työnantajasta:
( 0 arvostelua ) San Jose, United States

Projektin tunnus: #19841549

21 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_18% %project_currencyDetails_sign_sub_19%/tunti tähän työhön


Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl Lisää

$15 USD / tunti
(74 arvostelua)

Hi there, I am interested in your project. I am good at Scrapy and Selenium. I have 4+ years’ experience at Web scraping. If you'd like to view my previous work, take a look at my profile Lisää

$33 USD / tunti
(73 arvostelua)

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide Lisää

$11 USD / tunti
(23 arvostelua)

Hi. thanks for your posting. I'm very happy to have a chance of bidding your project. I have experience in development of the projects like yours If you hire me, I'll do my best for your project and finish greatly in a Lisää

$11 USD / tunti
(56 arvostelua)

Hi, ➲ 10+ years of full-time experience in Python / Django with 50,000+ Upwork hours billed and 50+ successful Python projects ➲ Upwork Top 10 Certification for Python and Django ➲ Guaranteed Results Policy: Pay onl Lisää

$12 USD / tunti
(14 arvostelua)

Hi, Sir!! @$@$@$PLEASE CONTACT ME. I CAN DO IT WONDERFULLY.$@$@$@ ##% Your idea is attracted me to your world.%## I am Python expert. i have various skills. @example@ python selenium and beautiful soup, regular Lisää

$12 USD / tunti
(30 arvostelua)

Hello! I have 1,5 years of experience in web scraping using Python (Scrapy, Selenium, requests etc) and I am interested in cooperation with you. I am ready to pass the interview with you.

$11 USD / tunti
(28 arvostelua)

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON Lisää

$11 USD / tunti
(55 arvostelua)

Hi! Client. Thank you for sharing your needs. I have read your description and clearly understood what you need. I am a senior developer having a lot of experiences in Mobile and Web App development for 7 years, s Lisää

$10 USD / tunti
(3 arvostelua)

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! A link to my examples portfolio! [login to view URL] Lisää

$12 USD / tunti
(2 arvostelua)

Hi Employer, I can extract any data from any [login to view URL] I have scraped the data from these websites & stored scraped data into CSVs and excels as per my clients requirement. :- You can check these websites... Lisää

$8 USD / tunti
(7 arvostelua)

✫✫✫ Dear Hiring Manager ✫✫✫ Wish you a very good day!!! After reviewing your post, I am very interested in that due to my experience. I’d like to be considered for your project position. I am an expert Web develop Lisää

$10 USD / tunti
(2 arvostelua)

Hello Sir, I have gone through your requirement more carefully. Basically,I have already experienced creating the various similar project related to automation using python automation tool like selenium. I have also us Lisää

$12 USD / tunti
(4 arvostelua)

Dear Sir/Madam, Thank you for giving me a chance to bid on your project. I am a serious bidder here. My name is Nathan and I'm very interested in and willing to do your job. I'm a data scraper professional from DataSc Lisää

$10 USD / tunti
(1 arvostelu)

We are a web developing and designing company with various other facilities such as web content and digital marketing related to all types of specializations. Additional considerations and implementations are assiste Lisää

$12 USD / tunti
(0 arvostelua)

Hello, I am interested in your job and can make automation bot upon your requirements. Doing Web Automation and Windows/Desktop Automation based tasks from five years. Offers Solution for Your Everyday Problems. Manua Lisää

$11 USD / tunti
(0 arvostelua)

I'm currently a software engineering student and would love the opportunity to gain some experience!

$9 USD / tunti
(0 arvostelua)

I have worked on crawling data from different sources and updating our own Dataset. I have also worked on framework like flask. Django and python scripting actively.

$15 USD / tunti
(0 arvostelua)

Hi, I can help you with your work I have already made projects such as [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL]

$11 USD / tunti
(0 arvostelua)

Hello I am a Senior Python developer has over 6 years experience in python script/app development. I've built a lot of python scrapers using Scrapy framework and Selenium/Phantomjs/Requests/lxml/bs4 packages. And Lisää

$10 USD / tunti
(0 arvostelua)