Find Jobs
Hire Freelancers

Extend nokogiri scraper to new site to populate MySQL DB

$250-750 AUD

Suoritettu
Julkaistu lähes 10 vuotta sitten

$250-750 AUD

Maksettu toimituksen yhteydessä
Stagecoach Software Pty Ltd (trading as RateMyAgent) has fully functioning ruby Nokogiri scrapers populating a MySQL database from certain websites. The scrapers are based on a VPS and run on daily cron jobs. The scrapers generate thousands of rows of data per day in two key tables plus further rows in related tables. The database is designed to function as a backend to a forthcoming website. This project requires a freelancer to adapt the existing scraper code to operate on a fifth website operating in the same industry and displaying the same type of data. The existing code is available on github. A sample database is available on Heroku. These may be inspected by approved bidders before they accept the project but development is to take place on another development database on the VPS. All code must be posted to and deployed through github. The new scarper must use existing code as much as practicable. Sundry other minor changes to the code and database may be required as the project progresses to help achieve the corporate objective of providing a useful and functioning website. The freelancer must ensure that the current production database and existing scrapers continue to operate without interference throughout the project. Fixing bugs identified within a week after production are to be included in the price. Further written instructions including identification of the site to be scraped will be provided to approved bidders. Bidders are free to revise their bids upon studying the instructions, the code or the existing database. This project follows freelancer Project ID’s 5477803, 5129765, 5066285, 4975478, 5799583 and 6103569 Further similar scraping projects for other sites will be offered to the successful bidder if this project is completed successfully. Those scraping projects will be followed by the creation of a RoR website that will present graphs showing aggregate and individual data obtained from the database and allowing complex user searches. Preference will be given to freelancers interested in and qualified to carry on work in the further backend projects and subsequent building of the website. Bidders without demonstrable experience in Ruby, MySQL and Web Scraping will be rejected. Bids placed within minutes of the project being posted will also be rejected as indicative of no thought being applied to the project requirements.
Projektin tunnus (ID): 6195613

Tietoa projektista

6 ehdotukset
Etäprojekti
Aktiivinen 10 vuotta sitten

Haluatko ansaita rahaa?

Freelancerin tarjouskilpailun edut

Aseta budjettisi ja aikataulu
Saa maksu työstäsi
Kuvaile ehdotustasi
Rekisteröinti ja töihin tarjoaminen on ilmaista
Myönnetty käyttäjälle:
Käyttäjän avatar
Hello, I will create parser for this new site as discussed before. New scraper will be created as new branch on github and merged into master branch after testing. Regards, Oleksandr Movchan
$600 AUD 7 päivässä
4,8 (3 arvostelua)
4,3
4,3
6 freelancerit tarjoavat keskimäärin $515 AUD tätä projektia
Käyttäjän avatar
Hello, Please let me review existing source code. Thanks
$600 AUD 10 päivässä
5,0 (2 arvostelua)
2,6
2,6
Käyttäjän avatar
Предложение еще не подано
$555 AUD 5 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hi I have read your requirements. I will show you my data scraper code later. I am Javascript, ROR and Capybara/Cucumber/Rspec developer, having 4+ years of experience in web development with expert in javascript, web designing, social API integration, Heroku, AWS, GIT, Cucumber, Capybara, Rspec. I have done various projects on RoR and now I am feeling very confident and more familiar with RoR. My Skiils are: Core - Ruby and Ruby on Rails, Web application development Front end - Javascript, HTML, CSS, design & interaction, rich interfaces Database - MySQL, Postgres Middleware - Redis/Resque, Memcached Architecture - Messaging/Message Queues, Backgrounding, Integrations Methodologies - Scrum/Agile, TDD, BDD, pair-programming Skills/Experience - Enterprise-class Software-as-a-Service (SaaS) development - Working knowledge of full-text search technologies (Lucene, Sphinx, etc) - Working knowledge of Redis & Resque - Experience with Dev Ops for large scale Rails application - Strong debugging and data spelunking skills - Working experience of API Integration - Working Experience of Automation of Web application Thanks
$333 AUD 10 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hello, I am a webscraping specialist. I am a professional software engineer with 15 year work experience. I spent the past 4 years focusing exclusively on data extraction and web automation. I have implemented scrapers in many languages and I believe you can benefit form my expertise implementing best practice in your project. I can ensure you clean and concise code. I use css selector, xpath, regex on a daily basis. Looking forward to hearing from you, Best regards, Frederic Bazin
$555 AUD 10 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hi i seen your requirement, I am very much interested to take this opportunity with specified price for per hour. Coming to my technical knowledge ,i know Ruby On Rails,HTML,CSS,Jquery. And i have 4+ years of experience in IT industry. I hope we will work together. Thanks & Regards kishore cheruku
$444 AUD 10 päivässä
0,0 (0 arvostelua)
0,0
0,0

Tietoja asiakkaasta

Maan AUSTRALIA lippu
Idalia, Australia
5,0
53
Maksutapa vahvistettu
Liittynyt helmik. 25, 2013

Asiakkaan vahvistus

Kiitos! Olemme lähettäneet sinulle sähköpostitse linkin, jolla voit lunastaa ilmaisen krediittisi.
Jotain meni pieleen lähetettäessä sähköpostiasi. Yritä uudelleen.
Rekisteröitynyttä käyttäjää Ilmoitettua työtä yhteensä
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Ladataan esikatselua
Lupa myönnetty Geolocation.
Kirjautumisistuntosi on vanhentunut ja sinut on kirjattu ulos. Kirjaudu uudelleen sisään.