Suljettu

Scrape newest real estate listings with Ruby and Active Admin as CRUD -- 2

We want to scrape real estate listings of 3 different websites. More websites will be added later. Ideally we can add more websites by configuration (ideally we can configure the regex for each variable). We will provide a briefing with all values marked on the respective listings pages.

The goal for the tool is to scrape the newest listings so we can check them and if needed, post them on our own platform (of course with a reference to the source) instead of copy-paste them by hand.

The scraper should have the following behavior:

- 1st we scrape the index/result pages to find newly added listings

- 2nd we visit and scrape individual listings

The scraper should not scrape more than 5 listings per hour per website to prevent unnecessary load and the scraper from being banned.

Scraper has to be developed in Ruby (or RoR) and we will use Active Admin as CRUD for the data management. Database will be PostgreSQL.

You should also be able to set this up on Amazon AWS (EC2/RDS/S3). We might also integrate the tool you develop into an existing setup.

In addition you know about using proxies and can implement that.

Finally, please add the result of 6+5=? to your bid, so we know you're not a bid bot.

Taidot: PostgreSQL, Ruby, Ruby on Rails, Tietojen kaavinta verkosta, Amazon Web Services

Näytä lisää: scraping real estate listings, populate database real estate listings, real estate listings website backend, joomla real estate listings, fast loading real estate listings aspnet, populate website real estate listings, real estate portal login password admin, google maps real estate listings project, elgg real estate listings, real estate listings import table, real estate listings, free real estate listings intergration, google maps real estate listings php, drupal real estate listings, real estate listings feeds, scrape real estate listings, scrape sites real estate listings, active real estate listings, Scrape images and text from proprietary database of real estate listings

Tietoa työnantajasta:
( 26 arvostelua ) Zollikon, Switzerland

Projektin tunnus: #24081228

25 freelanceria on tarjonnut keskimäärin 591$ tähän työhön

seaanddream

result = 11 Hi, my name is Selim. I am from UK. I read your "Scrape newest real estate listings with Ruby and Active Admin as CRUD --2" project descriptions carefully before bidding. I checked your requirements as well Lisää

$550 USD 7 päivässä
(285 arvostelua)
8.0
zekovicm

11 Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. What are the URLs of those 3 websites ? Please feel free to initiate the chat so that we can discuss further details. Thank you for taking the tim Lisää

$650 USD 14 päivässä
(121 arvostelua)
7.4
srinichal

You can bank on me for the expertise in scrapers and crawlers I have. Having delivered many such similar projects in the past, I look forward to discuss and start the project inline to your requirements

$500 USD 7 päivässä
(66 arvostelua)
6.7
arvindkushwah9

Dear, I have 7+ years experienced in Web Development. When I read this job I feel very excited to be a part of your project and share my great experience in software development. Specialties: Ruby on Rails, RESTful Lisää

$500 USD 7 päivässä
(78 arvostelua)
6.8
TheScorpion93

result = 11 Please, contact me and send me the link to the site so I could make a FREE SAMPLE Please, contact me and send me the link to the site so I could make a FREE SAMPLE Hi there, I’ve read your brief, We are a Lisää

$500 USD 7 päivässä
(70 arvostelua)
6.4
maysam

6+5=11 I have done this before for an Australian client, this is not very trivial and if you are not careful your IP would eventually get banned from their servers

$2000 USD 30 päivässä
(20 arvostelua)
6.2
MezbahAlam

6+5=11 Hi, i'm good at web scraping . Last year, i created private ruby gem for scraping specific site. Experienced on ActiveAdmin Gem , Postgresql database. Also I can deploy it on EC2 . Thanks, Mezbah Alam

$500 USD 7 päivässä
(53 arvostelua)
6.3
abhisyc70

Hi, I will build the scraper in Java(although Ruby is not a problem. I have expertise building scrapers in Java). I will set up cron jobs on EC2 instance to trigger the "NEW LISTINGS" scraper each day and "INDIVIDUA Lisää

$500 USD 6 päivässä
(9 arvostelua)
5.8
rubyonrailsdev21

Dear Client , Hope you are doing well, I have reviewed the job post and would like to join you as a fullstack ROR developer. I am full time and immediately available for this job (40 hrs in a week ) and having excellen Lisää

$250 USD 5 päivässä
(42 arvostelua)
5.9
nikhil929

11 Greetings, we have relevant experience in scraping Real estate website using python and scrapy and getting the output in the desired format as well Please share us the target website and the key fields Lisää

$500 USD 7 päivässä
(10 arvostelua)
4.4
azam72

I have gone through the above-mentioned details very well. I have got plenty of experience in ruby on rails, web scraping, amazon web services, postgresql, ruby kinds of works and I can assure you that I can reach your Lisää

$456 USD 7 päivässä
(1 arvostelu)
3.2
mquesada90

11 Hello Thank you for your posting. I am Marvin who has a lot of experiences in scraping. I am familiar with R programming and AWS service, too. In scraping, we should bypass the sites' limitation so proxy used to be Lisää

$500 USD 7 päivässä
(1 arvostelu)
3.4
yushuai117

11 Hi, I can do that and have rich experience to scrape data from websites. Please contact me via private chat. Regards, Fan

$500 USD 7 päivässä
(1 arvostelu)
1.4
PixelsInn

"11" We have past experience of scraping websites using Scrappy, Beautiful Soap and Selenium. We recently have developed a scraper for a website, you can review the video of the web scrapper here: https://drive.google. Lisää

$800 USD 15 päivässä
(0 arvostelua)
0.0
ahmadkamrans

11 Hi, I have been working in ruby on rails for more than 3 years and I have expertise in web scraping. I have looked into the description you have provided and I have worked recently on such kind of a project. Basica Lisää

$555 USD 10 päivässä
(0 arvostelua)
0.0
ankleshsingh

11 Hi, Hope you are doing good. I have gone through your requirement and I do have skill set you are looking for. I have expertise in scrapping as well, refer below links shared for review from seller. I am certifi Lisää

$388 USD 3 päivässä
(0 arvostelua)
0.0
webdroid

Hi, I can Scrape newest real estate listings with Ruby and Active Admin as CRUD for you on time and within your budget. Website design and development work portfolio: https://www.freelancer.com/u/webdroid Skills and Lisää

$450 USD 5 päivässä
(0 arvostelua)
0.0
realestate9898

Hello, I can work with WordPress instead which is more user friendly and SEO organized. ***If you need a web scrapper you will need to get like Franchise solution: [login to view URL] ***Also Importer/Ex Lisää

$500 USD 7 päivässä
(0 arvostelua)
0.0
satarupghoshal

Upon reviewing your requirements carefully, as per my best knowledge and belief, you need Enterprise Resource Planning(ERP)/CRM application. Our customization and Integration of Management Business software ensures tha Lisää

$250 USD 7 päivässä
(0 arvostelua)
0.0
gargankit642

Nice to meet you I am an Amazon Cloud Architect for the web infrastructure serving 90 million page impressions and 12 TB Internet traffic per month. The AWS services I use are EC2, ELB, MySQL RDS, VPC, CloudFront, Elas Lisää

$637 USD 9 päivässä
(0 arvostelua)
0.0