Crawling videos from internet
$250-750 CAD
Maksettu toimituksen yhteydessä
I would like to build an application using either node.js or Grails to Crawl the videos from the websites listed below. The application is able to parse the web page and identify if the web page contains video content (excluding ads). If it does, store the url, video description, title, and uploaded date in a NoSQL (possibilly Mongo) database. The application and database is hosted in AWS cloud. The application runs twice a day. The database contains no duplicate urls.
Business Insider: [login to view URL]
Fortune Magazine:
Forbes
The Economist
WSJ Business
Bloomberg
The Street
Consumerist
Financial Times
Projektin tunnus: #9618422
Tietoa projektista
9 freelanceria on tarjonnut keskimäärin $702 tähän työhön
Hello, I have experience in Grails as well as nodejs but I will prefer crawling using nodejs with mongodb database. Let me know good time to discuss with you
I got 7+years work experience in Data Collection,Bulk Email Campaign,Excel VBA and Internet Research in IT companies here.I can do create script and scrap datas from the sites using C++,C#,Java,Python and Perl codi Lisää
Hello, I have developed several application similar to this one in Node.JS and I'm sure I'll be able to deliver what you expect from the project. Don't hesitate to contact me.
experiences mongo or couchbase php5 or node.js config linux server nginx web server yii framework or pure php
