We require an expert programmer with extensive background in web scraping and data collection projects. The project is centered around creating a Sina Weibo data collector and hosting it on the cloud. The developer will be responsible for end to end development as well as setting up the project on a preferred cloud hosting. There should be API's available for us to interact with the collection center. The avatars/accounts and/or API keys if required will have to be arranged by the developer. Once done, the developer has to ensure that the project runs on a no interruption basis for next 1 year. For the same the developer can charge us a monthly support fee. The source code needs to be shared with us along with the documentation. The project is divided into 2 phases, an implementation phase and a support phase.
What we would like is as follows:
1. Create a project which can accept keywords/hashtags and user names as inputs, along with duration for which they need to be monitored
2. Setup necessary avatars/APIs required to collect such data
3. Once collected the data can be stored temporarily on the cloud ona DB of developer's choice
4. Expose APIs for us to retrieve the data based on certain filters.
5. Manage priority for different data collection sensors.
It will be preferable if the developer can demonstrate previous work history in similar project it. Communication in english is much preferred.
If you are applying please do clearly mention how you would approach this problem and cite previous work if any.