Find Jobs
Hire Freelancers

Crawling tool with Scrapy and Mongo

$30-250 USD

Suljettu
Julkaistu yli 4 vuotta sitten

$30-250 USD

Maksettu toimituksen yhteydessä
- We need you to build us a crawling tool from scratch which follow these requirements: --- Requirements --- - The tool should be used Scapy Python and MongoDB. - It should dockerized into docker-compose separated into two containers: web and db. - It should be easier to extend if we gonna crawl the new site. Such as we will have folderA will crawl site A, folderB will crawl site B...etc - It should be easier for configure the database and the site we gonna crawling. - When the structure of codebase is done, we will review it and you need to send us a documentation to show: + How can we setup crawler for new site ? + Which file/folder need to be created + Which command need to be executed to crawl all the sites which were configured in the codebase. - We will send you an example site, so you will do an example for us when the structure of codebase is done. - I will send you invitation to github repository then you will work on it. ---- Note --- - Please read it carefully before you ask us or bid with the right price. - Only release payment if the codebase is good enough and easy for us to crawling the site. - Please mark prefix 'DDPythonMongo' when you bid. Otherwise, I'll skip the bid due to automatically bid or bot.
Projektin tunnus (ID): 21405415

Tietoa projektista

10 ehdotukset
Etäprojekti
Aktiivinen 5 vuotta sitten

Haluatko ansaita rahaa?

Freelancerin tarjouskilpailun edut

Aseta budjettisi ja aikataulu
Saa maksu työstäsi
Kuvaile ehdotustasi
Rekisteröinti ja töihin tarjoaminen on ilmaista
10 freelancerit tarjoavat keskimäärin $182 USD tätä projektia
Käyttäjän avatar
Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. What is the website? 5. How many results/urls are there? Thx, waiting for these details and hope to collaborate.
$180 USD 5 päivässä
5,0 (39 arvostelua)
7,4
7,4
Käyttäjän avatar
Hello Respect sir I saw your description, I can't stand the excitement of seeing the project you post on... I bet one's shirt on I have the ability to complete your project perfetly because I have experience with your projet. Let me explain my basic experience at the first. I have been working as the development team leader for 21 years and my basic skills are Object C, C++, C#, Java, Javascript, Pythone, Node.Js. So I have about 1000 web Crawling(Scraping) experiences.(SportsBetting site(Bet365, Betfair, Maxbet, 1Xbet, Aleabet, Stanleybet, Glodbet, Wiliamhill, Eurobet, ---Betburger, Blogbet, Oddsportsal) , CasinoBetting site, Shopping site, Booking site, Dateing site , Nomal site..) The most amazing thing for me is to have a complete analysis and understanding of the betting parts and to have control of Betfair, Bet365, Pinnacle, Bwin, Stanleybet, Planetwin365, Eruobet. etc. Also,the automatic sports '*'Betting Bot'*' for these things (ValueBet, Surebet) I built and more than 1700 clients is contacting me, they are earning a lot of money for use my bots. Also the income of the bot is Awesome!! Please Contact me , I will share when you contact with me , you can check it yourself. In these latter day I have some free times, So I have time to work with you preferentially. Verve !! This is a source of creation Thank you for wishing you happy!
$140 USD 7 päivässä
4,9 (88 arvostelua)
6,9
6,9
Käyttäjän avatar
DDPythonMongo Good day of today! I am a senior web developer with rich experiences about scrapy python and mongo db management. After checking your post carefully , I am convinced that I can complete your project and waiting for your response. Best Regards.
$600 USD 15 päivässä
4,9 (24 arvostelua)
5,5
5,5
Käyttäjän avatar
DDPythonMongo How are you? I'm interested in your project. I've read your requirement carefully. In my precious working years i have finished many succesful projets with 100% customer satisfaction. I am a full stack developer.( Angular,react,Vue,laravel,ionic framework, node.js,express and many more.) I will perform your project with high quality on time as you want. I am free now, I can start to work in your project immediately. I am very happy to have an opportunity to work for you. best regards
$140 USD 7 päivässä
4,9 (32 arvostelua)
5,2
5,2
Käyttäjän avatar
DDPythonMongo Hi, I have gone through your project description. I can do this work easily. I am a full stack developer with extensive experience in both front and backend technologies. I build apps using modern architectures and latest technologies like : nodejs , expressjs , MongoDB / MySQL , reactjs / vuejs, angular, bootstrap or materialize css to develop web app for you . I can build your website frontend with Angular JS or Vue JSand I like to solve complex problems, related to development and bring new ideas to life I write clean and well organized code with proper comments. Get your work done guaranteed! Why work with me? You will have the guarantee to have your UNIQUE designs and not a template everyone is using. Using minimum code and converted images, the loading speed of the website can be extremely fast. Proper design and UX contributes to the conversion rate, along with the mentions above. Regards Pooja
$150 USD 10 päivässä
5,0 (4 arvostelua)
4,3
4,3
Käyttäjän avatar
Hi, there. My name is Han, and I have 5+ years of experience in developing websites using HTML, CSS, JavaScript & several frameworks such as Python, Shopify, Wordpress, and Laravel. I read your job description and checked your link, and I am interested in your project. As a dedicated full stack developer, I think I can satisfy you by completing your project in high quality in the deadline. I am free now, I can start to work on your project immediately. I would love to have an opportunity to discuss this with you for further details. Best regards
$120 USD 7 päivässä
5,0 (1 arvostelu)
3,5
3,5
Käyttäjän avatar
HI, I HAVE EXPERIENCE IN WORKING WITH WEB CRAWLING AND SCRAPING THE DATA FROM WEB SITES AND ABLE TO SCRAP THE DATA USING JAVA, PYTHON, PHP AND USING THE MYSQL AS MY DATABASE. AND THE BID IS NEGOTIABLE WANT TO NEGOTIATE PLEASE CONTACT.
$111 USD 6 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Currently working at a large project where my responsibilities are crawling, maintaining and updating big websites like google news, yahoo news, bing news etc.
$140 USD 7 päivässä
0,0 (0 arvostelua)
0,0
0,0

Tietoja asiakkaasta

Maan VIETNAM lippu
Ho Chi Minh, Vietnam
5,0
2
Liittynyt marrask. 26, 2016

Asiakkaan vahvistus

Kiitos! Olemme lähettäneet sinulle sähköpostitse linkin, jolla voit lunastaa ilmaisen krediittisi.
Jotain meni pieleen lähetettäessä sähköpostiasi. Yritä uudelleen.
Rekisteröitynyttä käyttäjää Ilmoitettua työtä yhteensä
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Ladataan esikatselua
Lupa myönnetty Geolocation.
Kirjautumisistuntosi on vanhentunut ja sinut on kirjattu ulos. Kirjaudu uudelleen sisään.