Suljettu

Fixing two bugs in a webscraping project in R / rvest (only 5 lines of code!)

I want to scrape some data on this page here:

[login to view URL]

which has the CSS selector ".paddTD10"

The data is invisible until you hover your mouse over an item in the table. I'm unable to extract any data (empty list returned). However, I confirmed that the CSS selector is correct, as you can tell from the yellow markings from SelectorGadget on screenshot #1. (Bug #1)

If one clicks on an item in the "symbol" column and scrapes the subpage that gets opened, the very same selector works with only one problem: The html_table() function ignores the last column (Bug #2), even if SelectorGadget marks the whole table. -> screenshot #2

I'm paying you because I want to learn from my mistakes and improve my own coding.

My priority is (from highest to lowest) fix for bug #1, if not possible then workaround for bug #1, then fix for bug #2 (I already have a workaround).

Therefore we will break down the project into these milestones:

Workaround for Bug #1: 40% of total payment

Direct fix for Bug #1: 40% of total payment -> 80% of total payment (including 40% for the workaround that is not needed)

Direct fix for Bug #2: rest (=20% of total payment)

This is my R script:

library('rvest')

url <- "[login to view URL]"

allassetdata <- read_html(url) %>% html_nodes(".paddTD10") %>% html_table(fill = T)

url <- "[login to view URL]"

singleassetdata <- read_html(url) %>% html_nodes(".paddTD10") %>% html_table(fill = T)

Taidot: CSS, HTML

Näytä lisää: i need quetions and answer site, i need quetions and answer, i need a project manager, betfair api r, web scraping in r, betfair score api, betfair sportsbook api, horse racing odds api, odds comparison api, r bloggers web scraping, github abettor, python, web scraping, shell script, i need a project manager uk, i need a project manager in maryland, i need a project manager for startup brasil, i need a project manager for retail, i need a high speed 5 or more data entry operator for our offline project that is only filling the form of 44 fields, i need a graphic designer for one project

Tietoa työnantajasta:
( 1 arvostelu ) Puschendorf, Germany

Projektin tunnus: #16593214

12 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

royalwebraisers

HI, I can help you in getting the data which comes on hover of the website. Let me know when we can discuss and start working. Looking forward for your response. Thanks.

€31 EUR 1 päivässä
(40 arvostelua)
5.5
ludwig333

Hi I am an expert in python and R. I have a lot of experiences in Web scraping by using R and selenium. I have an interested about your project. I would like to have a discussion with you.

€23 EUR 1 päivässä
(16 arvostelua)
5.5
o2io

Hi there, My name is Anik- a software engineer and a lead python developer. I’ve read your brief carefully, here I am to crap data. Scrapped data from following websites. [login to view URL] [login to view URL] Lisää

€30 EUR 2 päivässä
(18 arvostelua)
3.8
WebExpertNatasha

I can do that within only 30 minutes Looking forward to hearing from you... Thank you....................................................................................................................

€23 EUR 1 päivässä
(12 arvostelua)
3.7
€23 EUR 1 päivässä
(10 arvostelua)
3.5
baphpwordress

Hi, we can decide rates from your side (price can be negotiated) I understood your requirement I have knowledge in this filed 5+ yr so many projects I have done. kindly let me know in brief what kind of req Lisää

€19 EUR 1 päivässä
(5 arvostelua)
2.7
Parveensuthar

Hi Parveen Kumar from india here.I can deliver this project successfully. I think I’m a great fit for this project because I have an interest in project and can deliver on time, according to your specifications. Lisää

€34 EUR 1 päivässä
(1 arvostelu)
2.5
€12 EUR 1 päivässä
(7 arvostelua)
2.3
€23 EUR 1 päivässä
(2 arvostelua)
1.7
akshitagarwal10

I have experience working with web scraping using selenium, multi-threading etc. in python. My profile is new but i am experienced and assure you that will get your work done.

€10 EUR 1 päivässä
(2 arvostelua)
0.5
jamesmatuie0422

Hello, Thanks you for your job posting. I read your job description carefully and I'm sure I'm the most perfect candidate for this job. Please feel free to contact me. Thanks, James

€8 EUR 1 päivässä
(0 arvostelua)
0.0
deeptisangwar5

I Read Your Project Description I can do it in your project please ping me more discussion about your project. I will provide 1-day free work. I am an Expert team of India. We are a well-known company offering profe Lisää

€23 EUR 1 päivässä
(1 arvostelu)
0.0