Build a web scraping script

I would like to gather a database of famous quotes and proverbs, and would like to have a web crawler / scraper to automate the process.

The "ambitious" objectives of the project are:

- Input of the script / program - keywords, that can be themes (e.g. inspirational quotes, music quotes, quotes of the day) or authors (e.g. barack obama, mother theresa, etc.).

- The script will then access google and pull out maybe the top 30 sites of that keyword, and attempt to extract as many quotes / proverbs as possible from those sites.

- The script will output the data in a csv file, contain the quote itself, the author, and where was the source.

- The script need not be something that runs on a regular basis. Just have to churn out the output based on the input.

Understand that this is not easy technically, so I'm open to counter proposals too on how best to achieve the same objective of having a quotes database from the web.

Looking forward to your interest to work on this together.

Taidot: Python, Tietojen kaavinta verkosta

Näytä lisää: web scraping tutorial javascript, web scraping tutorial php, web scraping with python amazon, python 3 web scraping, web scraping with python pdf, web scraping with python: collecting data from the modern web, web scraping tutorial python, web scraping python beautifulsoup, kayak web scraping script, outsourcing web scraping work, php script web scraping, script send webform data csv file, script web scraping, aspnet save form data csv script send webform data csv file , perl web data scraping script, php web scraping script, sql select data csv file perl script, web scraping php script, web scraping script, web scraping script perl

Tietoa työnantajasta:
( 6 arvostelua ) Singapore, Singapore

Projektin tunnus: #15106735

35 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Dear Sir, I specialize in web development, web scraping and data mining projects. Please open chat with and lets discuss in more details about the project. Many thanks!!! Relevant Skills and Experience PHP-cURL, Pha Lisää

$555 SGD 20 päivässä
(66 arvostelua)

Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. Relevant Skills and Experience Python, Web Scraping Proposed Milestones $526 SGD - Negotiable I Lisää

$526 SGD 10 päivässä
(159 arvostelua)

Dear Sir ,I am interested in your job and I wish to work with you. I think you can check my profile and reviews and check me :) I have rich experience in these fields :javascript , PHP , nodejs C Programming, Softw Lisää

$300 SGD 10 päivässä
(51 arvostelua)

Nice to meet you. I 've read your post and so very interested in your job. I 'm sure I can satisfy you with my ability. I 'm working in part of coding and software developing for over 6 years. I have experiences th Lisää

$555 SGD 10 päivässä
(82 arvostelua)

Lets start. Having a team of Professionals. We provide high quality work with accuracy. Would you like to discuss more about your current requirements? Relevant Skills and Experience Web scraping Proposed Milestones Lisää

$361 SGD 3 päivässä
(166 arvostelua)

Hello Can we discuss. I have done many web scraping projects perfectly. Before start work, I will show you sample. Thank you Relevant Skills and Experience scraping tool create Proposed Milestones $555 SGD - d

$555 SGD 5 päivässä
(64 arvostelua)

Greetings sir, i can help you to create script and gather a database of famous quotes and proverbs and your 100% satisfaction is assured if you allow me to serve. Relevant Skills and Experience I have the 5 years of Lisää

$500 SGD 5 päivässä
(30 arvostelua)

Dear Client. I read your job post carefully and I believe I possess the necessary skills and experience you are seeking and would make a valuable addition to your company. Relevant Skills and Experience As my profile Lisää

$666 SGD 10 päivässä
(10 arvostelua)

Hello! I'm web-scraping and web automation expert. I have 5 years of experience and i have 500+ finished projects (ecommerce, directory listing, etc...) Relevant Skills and Experience I use python language and scrapy Lisää

$483 SGD 10 päivässä
(109 arvostelua)

Hi, sir! I have a good skill in python and web scraping programming. If you award this project to me, I'll complete it in time. Thank you in advance. Stay tuned, I'm still working on this proposal.

$500 SGD 10 päivässä
(41 arvostelua)

A proposal has not yet been provided

$388 SGD 5 päivässä
(79 arvostelua)

Hi, I am FURKAN a CERTIFIED PYTHON,WEB SCRAPPING EXPERT . I would love to provide you Quality Scrapper that can scrape database of famous quotes and proverbs and put output in a CSV file as per your requirements Lisää

$250 SGD 1 päivässä
(45 arvostelua)

Hello Client, Hope you are doing well ! I have great experience of extracting information from websites . I provide best solutions at fastest speed with the cheapest cost. Your satisfaction is my only priority. I wou Lisää

$250 SGD 3 päivässä
(15 arvostelua)

Hi, - I am a Python developer with proven and extensive experience in web scraping projects using Python (Beautiful Soup library) with demonstrated quick turnaround. - Experienced with advanced web scraping techniqu Lisää

$550 SGD 20 päivässä
(17 arvostelua)

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects similar to this Relevant Skills Lisää

$333 SGD 7 päivässä
(32 arvostelua)

Hello Hiring Concern, I have all the skills required for this job. I am ready to start immediately. Sincerely, Ashwani Relevant Skills and Experience I have reviewed all the requirements shared by you in the job des Lisää

$555 SGD 10 päivässä
(20 arvostelua)

A proposal has not yet been provided

$250 SGD 7 päivässä
(13 arvostelua)

I can complete your web scraping requirement on time with good quality results using Python scripting I start scripting right away and deliver the results within your timeline I use Python BeautifulSoup and Scarpy li Lisää

$385 SGD 3 päivässä
(29 arvostelua)
$422 SGD 10 päivässä
(15 arvostelua)
$373 SGD 10 päivässä
(11 arvostelua)