I need to collect data from a website and put it in a spreadsheet, that will have 15 million rows and 6 columns.
There are about 15 million names on a website. These names are on 971,642 pages -- 15 names per page. To get to the next page of 15 names you have to click "next page." This list of names will be column 1 of the spreadsheet.
Also, I will need you to develop a script that clicks each of these 15 million names. Each name you click will open another web page. On each of these 15 million pages, there is a simple table. I need 5 columns of data from each table. This will provide columns 2-6 of the spreadsheet you are creating.
I am a graduate student and thus don't have a large budget for this task.
15 freelancers are bidding on average $94 for this job
Hi. This project can easily be done in a couple of days. We have the right people for it. Please, consider us for doing this job. Greetings, Matias Blanco CEO - BlueAngel Development
I'm working on similar kind of webscraping projects and I have a template ready for your kind of work. Just need to modify as per your requirements which can be done in one day along with testing.