Run Scrapy spiders in parallel - when triggered from Flask Application -- 2

Suljettu Julkaistu 2 vuotta sitten Maksettu toimituksen yhteydessä
Suljettu Maksettu toimituksen yhteydessä

2 Tasks - Project budget (Max 5000 INR)

1. I have a flask web application that runs scrapy spiders at the click of a button. As of now, all spiders are running one after another, I want them to run in parallel. Also, when the button is clicked it should be disabled untill complete spiders execution has been completed.

2. Deploy on Heroku or Pythonanywhere

Python Tietojen kaavinta verkosta Scrapy Flask

Projektin tunnus: #31559485

Tietoa projektista

7 ehdotusta Etäprojekti Aktiivinen 2 vuotta sitten

7 freelanceria on tarjonnut keskimäärin ₹3921 tähän työhön

cpox

I can help you convert your scrapy spiders from running one-at-a-time to running in parallel. I can also help you deploy this flask server on heroku as you've specified. Get in touch via chat to discuss the details. Th Lisää

₹5000 INR 7 päivässä
(11 arvostelua)
3.7
ArvindPuro008

I have worked on CI/CD for various projects in professional career, it looks like we can parallelise the stages. I am comfortable on python coding for scraping too.

₹4500 INR 10 päivässä
(0 arvostelua)
0.0
OsamaAlshafieAli

Hay there, Thank you for your post. I am Software Developer with +4 years experience. so i am sure i can help in this project. Don't worry about delivering i develop high qualified software quickly ASAP. this is not Lisää

₹5000 INR 5 päivässä
(0 arvostelua)
0.0
arshadaymen

Hi There, Expert in web crawling using python and scrapy | selenium etc. I have basic knowledge in Django and heroku I am interested in working on this, message me we can start now.

₹1500 INR 7 päivässä
(0 arvostelua)
0.0