Setup python+celery+redis+mongodb infra
Maksettu toimituksen yhteydessä
I am looking for a freelancer to set up my python+celery+redis+mongodb infrastructure. I already have existing servers that can be used for the setup.
The objective to merge candidate application data from three data sources - linkedin jobs, naukri and naukri rms. Each job will have a unique job_id and all the applicants from each data source will be tagged to one unique job_id.
[login to view URL] 1- A service will capture the data from each data source and upsert into each collection. eg. linkedin_jobs, naukri, naukri_rms. Since this service can run any number of times, the operation will always be upsert so that duplicates are removed
2. Stage 2- Upon completion of the upsert, there will be a collection called merged_data that will merge data from all three collections for a given job_id. This script will be based on a logic that we will provide. At the end of each upsert into stage1, the system will start a script to update the merged_data.
Your job will be to build and test these python+flask+celery+redis+mongodb scripts locally and then deploy and test them on AWS EC2.
Ideal skills and experience for this job include:
- Proficiency in python+celery+redis+mongodb
- Experience in setting up infrastructure for light workloads
- Strong communication skills to ensure smooth collaboration with me throughout the project
Projektin tunnus: #36686797