Web scarping and database set up


My name is Silvia and I'm a researcher and I'm looking to collect some data from the [login to view URL] website. It's basically a web scraping project but I would also like to have an accessible dataset to work with if the data cannot be extracted in a usable format. I need to extract multiple information from the website, but it is often the same information on a loop.

More specifically, I would like to access information about the results of the Championship Tour (CT) competitions of men and women in the last 6 years (2014-2019). Additionally, I would like to collect data on the athletes performances and rankings but this is more straightforward.

After the web scraping, if the data is in a usable format (i.e all the information comes from few datasets and the datasets could be extracted directly from the website) then that would be the end of the project. However, if the data extracted is not easy to use, then I would like to have it as a sort of database in excel (here attached). It should be similar to this (this is just a proposition) but it could change if there is an easier way to write the database.

If the data is not in a user-friendly format, I would like to have a database as the one here attached. As an example, I have filled up the information of Heat 1, Round 1 of the 2019 Men Quiksilver Pro Gold Coast. The broader indications on where to find the data that need extracting is found here below (this is just one loop of course):

Athlete's ranking information:

1. Go to [login to view URL]

2. Click on the top menu: Rankings

3. Choose: Men’s Championship Tour (THIS IS WHAT I NEED per year) (I also need all for Women’s championship tour in the last 6 years)

Competition results:

1. Go to [login to view URL]

2. Click on the top menu: Events

3. Choose: Men’s Championship Tour (I also need all the competitions for Women’s championship tour in the last 6 years)

4. Click: Quicksilver Pro Gold Coast (I need this for all the events as well)

5. Click underneath the picture, in the middle: Results

6. Click: Seeding round (I need this for all rounds of the event)

7. Go to Heat 1 and click: View details (I need this for all heats)

8. Choose: a. Heat details (THIS IS WHAT I NEED, ALL the information)

b. Career events stats (THIS IS WHAT I NEED but I only need it once per event, this doesn't change per year so I just need it once per athlete per event).

Then we need this for multiple years so we have to re-do:

1. Go to [login to view URL]

2. Click on the top menu: Events

3. Choose: Men’s Championship Tour (I also need all for Women’s championship tour)

4. Go to the year 2019: Change to 2018.

5. Repeat all process again from step (4) above.

6. Re-do all the process again for the last six years.

Thanks everybody! If you have any questions let me know.

Taidot: Tietojen kaavinta verkosta, PHP, tiedonlouhinta, tiedonsyöttö, Excel

Näytä lisää: best database for web scraping, extract data from website to sql server, web scraping into sql, web scraping into database, how to store scraped data into database, scrapy, web scraping tutorial, python web scraping to database, web forms database php, upload data web page database, web template database entry sql server, free php web templates database sql hosting nuke, web programmer database, web designing database electronics flash photoshop, web driven database quote, convert static web site database, web interface database application, web design database photoshop, web albums database iis, populate web page database php mysql

Tietoa työnantajasta:
( 0 arvostelua ) Fremantle, Australia

Projektin tunnus: #22261511

Myönnetty käyttäjälle:


hey Silvia, I can make you the database in EXCEL ACCESS or any other platform you want. I have reviewed the excel file template you attached. I have checked the website you described, I can SCRAPE data from this websit Lisää

$250 USD 2 päivässä
(177 Arvostelua)

47 freelanceria on tarjonnut keskimäärin 421$ tähän työhön


Hi, my name is Selim. I am from Solihull, UK. I read your `Web scarping and database set up` project descriptions carefully before bidding. I checked the target url, and attached template as well... I got what you need Lisää

$500 USD 10 päivässä
(388 arvostelua)

Dear Employer, Thanks for clearing it so well, I will do your job for sure. I have checked your attached file as well. Please give me this opportunity. Will give data as well the scraping tool. Please check my previo Lisää

$350 USD 3 päivässä
(219 arvostelua)

Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can collect some data from the worldsurf Lisää

$300 USD 5 päivässä
(422 arvostelua)

****6 Years of WEB Scrapping with DATABASE MANAGEMENT Expert**** I am interested to extract data I am a 6 -Years expert of Scraping or Crawling of any kind of website or directory having data in repeating sequence(Li Lisää

$500 USD 7 päivässä
(65 arvostelua)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Lisää

$395 USD 4 päivässä
(171 arvostelua)

yes checked the excel file, do you want the data into different tabs? i can make a script (scraper)for you and you can reuse in future, can you please message me i have few question.............................thanks.

$350 USD 3 päivässä
(315 arvostelua)

Hi, my name is Yanying Ding. I am from China. I read your `project name` project descriptions carefully before bidding. I checked the target URLs, and your requirements as well... I got what you need and ready to go Lisää

$500 USD 7 päivässä
(71 arvostelua)

First of all thank you for an excellent description! I can provide you a complete result in less than 24 hours. You'll receive Excel output + a web scraping script that you can use later for the same site. Thanks. R Lisää

$250 USD 1 päivässä
(548 arvostelua)

Hi there, I am interested in your project. I would approach your project by making a program to collect the data automatically. The program will be written in Python. The data will be stored in a mysql db. I have 4+ ye Lisää

$500 USD 7 päivässä
(94 arvostelua)

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some Lisää

$500 USD 7 päivässä
(120 arvostelua)

Hi Silvia, If you still need help please lets have a chat. Thanks Sorin

$500 USD 7 päivässä
(237 arvostelua)

Hi, I understand your requirement and can do the job well.I am professional web scraper. I can complete your web scraping requirement on time with good quality results using Python scripting. I start script right away Lisää

$500 USD 7 päivässä
(277 arvostelua)

HI, I can build a quick DEMO app, just a demonstration, which will extract and structure all the information you need. Just contact me and I will demonstrate my skills

$250 USD 7 päivässä
(1719 arvostelua)

Dear sir I am very interested in your project, because I have rich experience in such projects. I have good skills with the program language including C/C++, C#, java, php,, python, VB.NET. So I have expert and Lisää

$500 USD 7 päivässä
(46 arvostelua)

Hi, Would you like to see a quick sample list of your project on scraping the information about the results of the Championship Tour (CT) competition for male and female categories for the last 6 years and converting t Lisää

$500 USD 7 päivässä
(55 arvostelua)

Hello their, I have just read your project details and I have seen its something i.e lot of data entry project completed in given [login to view URL] I can easily do, Kindly award me this project and I would deliver quality Lisää

$250 USD 7 päivässä
(126 arvostelua)

Hello Sir, I have gone through all your required instructions and and understood what you need to get done. I will perform an accurate web search to collect the required contact details from your provided link and in Lisää

$250 USD 3 päivässä
(109 arvostelua)

Hi, I have understand the project requirement & interested to work for this project. I will complete it by time. Please send a message so we can discuss more & start the project. Thanks.

$250 USD 1 päivässä
(160 arvostelua)

Hi, I am very interested to work on your project. I have 17+ years experience in Web Development using a large variety of programming languages, frameworks, database architecture, APIs, CRMs, ERPs, mobile development Lisää

$750 USD 27 päivässä
(58 arvostelua)

This is a very simple task and I can get started immediately. I have over 5 years experience on automation and web scraping. With your permission, I could get started immediately and show you results in a few hours. I Lisää

$250 USD 2 päivässä
(43 arvostelua)