Suljettu

Send 1000k+ HTTP requests a second

We would essentially require a solution to make > 1000 HTTP requests in parallel a second.

Our proxy provider allows us to use residential proxies with an incredibly low latency.

Thus, speed is not a bottleneck in the given use-case nor should it be whatsoever.

In terms of a programming language, we would prefer Golang or Python to be used.

However, If you have anything else in mind then we're open to ideas!

The plan would be to have a solution which makes > 1000 HTTP requests in parallel a second while connected to a specified HTTP proxy (Oxylabs). It is an absolute requirement that we meet these specifications and have the resources to do so.

We have already looked into this topic but failed with little success due to host connection limitations or improper techniques used while attempting the given task. Thus, we have attempted to reach out to the world of Freelancer.

The endpoint (i.e. [login to view URL]) in mind is not to change although the payload (data) sent shall change with each request.

All required additional information shall be given upon request.

If you think that you could assist us from a long-time perspective then please do let us know as there is an opportunity to make a fixed amount of $1000-2000 every week. See this as more-so a test of knowledge then anything.

We have an example version of what we need done but it sadly has a bottleneck (hence why we posted here).

P.S. This is an urgent listing so please get back to us if you think you can do the job!

Taidot: C-ohjelmointi, C++ -ohjelmointi, Linux, Python, tietojärjestelmäarkkitehtuuri

Näytä lisää: trace http request, list of http requests, http request and response example, http request example, http get request example, http requests mozilla, http view request, http request methods, http requests, send getpost http server, send 300 friend requests myspace, send sms http server aspnet vbnet, concurrent http requests, send password http protocol, send messages friend requests myspace, send 100 friend requests, nusoap send xml http, configure cisco router send traffic http server, send binary http data iphone, send 100000 friend requests myspace

Tietoa työnantajasta:
( 3 arvostelua ) Luton, United Kingdom

Projektin tunnus: #17984443

18 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

istepin

Hi! I can implement such task for you using python 3.6 and asyncio, but to be fair I prefer to use C++ whenever I need a maximum performance (even I we talk about networking). Feel free to msg me in chat. Sincerely, Lisää

£23 GBP 1 päivässä
(7 arvostelua)
5.5
r030894

Hi, I have a knowledge using python with AWS lambda to do parallel requests. Per default, you can reach at maximum 5k requests at the same time using AWS lambda.

£18 GBP 3 päivässä
(6 arvostelua)
4.1
kil1967

Hi, I'm a experienced python developer. I'm very interesting on your job posting so have read it carefully. I have already sent 300 requests per second in pyhon code, and have experience in sending 100000 requests Lisää

£18 GBP 1 päivässä
(9 arvostelua)
2.8
TijanaD81

Hello! This resembles a load / stress testing scenario, which I've done a lot in the past prior to releasing numerous APIs to production. Python is too slow for this, GoLang would require a bit more programming than Lisää

£80 GBP 2 päivässä
(2 arvostelua)
2.7
anoops9895

Hi, I've worked quite a bit with writing server code for highly parallel and concurrent servers with multiple protocols. I've worked with servers that bypass the host OS network stack, as well as from within the ho Lisää

£111 GBP 15 päivässä
(1 arvostelu)
1.5
£55 GBP 5 päivässä
(1 arvostelu)
1.0
pikomonde

Hi, I'm Piko. I am a Go lang developer for 3 years now, and have been a web developer for 7 years. I have an involvement on a payment gateway project on a startup company that have 10k+ request/second. There is a Lisää

£10 GBP 1 päivässä
(0 arvostelua)
0.0
£100 GBP 7 päivässä
(0 arvostelua)
0.0
lucasalcantara

Hello, I think for this job we can use the language Golang to be faster than python. We can just start some goroutine to achieve all the requests that you want or use a lib for stress tests which I think can help us as Lisää

£18 GBP 10 päivässä
(0 arvostelua)
0.0
iviib

Hello! Your problem clearly. You can use any programming language. Anyway, eventually you work through the core of your operating system. Suggest you demo version of the program with parallel requests and res Lisää

£23 GBP 30 päivässä
(0 arvostelua)
0.0
statexpert215

Hi client I have read your requirements carefully. You have been trying to finish the task but failed with some reasons. I also think this task is not so easy and there would be used more low level language such C/C Lisää

£200 GBP 7 päivässä
(1 arvostelu)
0.0
marcinwylot

I believe my qualifications and experience match your specification. I have experience in building high performance systems, databases and HTTP servers working on multiple machines in parallel. Horizontal scaling would Lisää

£18 GBP 1 päivässä
(0 arvostelua)
0.0
alexg2018

I am new to Freelancer but I live and breath Go everyday. If the NIC capacity is not our bottleneck, reaching that rate is easily achievable in Go, as the language's native support for concurrency using Go routines and Lisää

£23 GBP 1 päivässä
(0 arvostelua)
0.0
atlassoft6

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on si Lisää

£18 GBP 7 päivässä
(0 arvostelua)
0.0
£16 GBP 3 päivässä
(0 arvostelua)
0.0
spielerisch

Hello, I wrote a similar script to the one you are describing and it can be realized in a few lines of code using Python. However I do have a few questions about your project. What version of python do you want the Lisää

£18 GBP 1 päivässä
(0 arvostelua)
0.0
johnserve

Hello, I'm offering just a consultation mainly because I assume you have already tried the techniques I am going to suggest. If not I'm willing to help with the implementation as well. I'm focusing on python and C++ Lisää

£18 GBP 1 päivässä
(0 arvostelua)
0.0
silvadom

Using Tensorflow Deep Learning library this can be achieved. Pure python multi threading or multiprocessing is limited. Take my bid in account for this challenge. Kind Regards, Dom

£333 GBP 5 päivässä
(0 arvostelua)
0.0