Build a semi-automated scrapper with user input

This project will be awarded to PigtailXL user. One of our employees approached him for a project called "Build a semi-automated scrapper with user input" - [url removed, login to view] . Our employee did the research and did it on our behalf. Now we can go ahead and do the project.


Original project post:

I have a client and they want to be able to create a new lead entry to Dynamics 365 by scrapping the content from [url removed, login to view] using the "Entity Name" from [url removed, login to view] (please be aware that these 2 websites are only accessible from the US or using a VPN connection).

The scrapping process will work like this:

1. user goes to [url removed, login to view], selects manually "Corporate and LLC", "Corporate" or "LLC"

2. user inputs the "SEARCH METHOD" and the "SEARCH" fields

3. the scrapper uses the company name from the bottom of "Corporation/LLC Name" and gets to the "CORPORATION FILE DETAIL REPORT"

4. the scrapper copies the "Entity Name" from the right site of the table (let's name this "copied field"

5. the scrapper goes to [url removed, login to view]

6. the user validates the Google reCaptcha

7. the scrapper searches in the "Employer" tab for state "Illinois", current date and "copied field" from the previous website, then click below "Search", then click on the search result

8. the scrapper copies the text that is below each of the following: "Insurance Coverage Provider", "Policy Number" and "Coverage Date"

9. the scrapper then uses Microsoft Dynamics 365 Web API to create a new lead inside a Dynamics 365 account that is supplied

I also attached images for all 9 steps.

Taidot: tiedonlouhinta, Dynamiikka, Javascript, PHP, Tietojen kaavinta verkosta

Näytä lisää: php user input city dropdown, load video based user input, user input form, java program ask user input exam scores, let user input image php, facebook user input, php user input database example, want flash program adds numbers user input, word template user input form, dnn user input module, vb6 best grid allow user input, user input facebook app, vba excel pop gui user input data

Tietoa työnantajasta:
( 4 arvostelua ) Chicago, United States

Projektin tunnus: #14788739

Myönnetty käyttäjälle:


Hello Sr. this is my offer, after we spoke with Madalina about the details of the project. Habilidades y experiencia relevante My skills/abilities includes website scrape and automation of processes. I will build a Wi Lisää

$250 USD 7 päivässä
(158 Arvostelua)

23 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


I have done a lot of scrapping and can scrap any site(even protected one) on challenge. My distinction, payment after your complete satisfaction with the resulted task. Relevant Skills and Experience http://apktower.c Lisää

$277 USD 3 päivässä
(270 arvostelua)

Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks Relevant Skills and Experience Data Minin Lisää

$250 USD 10 päivässä
(374 arvostelua)

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Lisää

$264 USD 6 päivässä
(329 arvostelua)
$277 USD 3 päivässä
(145 arvostelua)

Hey Friend, We are 14 person team of developer, designer and tester provide you excellent services. Relevant Skills and Experience Myself having has 10 years experience of web site development. Expert in Custom pr Lisää

$250 USD 8 päivässä
(223 arvostelua)
$257 USD 3 päivässä
(54 arvostelua)

Hi Thank's for providing us an opportunity to bid on your project. We read you project description and understand clearly so we are highly interested to work for you Relevant Skills and Experience We specialise in PHP Lisää

$250 USD 3 päivässä
(91 arvostelua)
$277 USD 3 päivässä
(19 arvostelua)

Hello sir. I read your attached files and sure I can do it. A few days ago I've completed vTiger CRM project. So I am the best candidate. Relevant Skills and Experience Web scraping(PHP-curl, c#, Python, [login to view URL], Lisää

$277 USD 3 päivässä
(61 arvostelua)
$250 USD 3 päivässä
(48 arvostelua)

Hey, I am good on automated scraping tool. I can give you a software demo for this need. Regards, Rocky Stay tuned, I'm still working on this proposal.

$250 USD 3 päivässä
(46 arvostelua)
$250 USD 3 päivässä
(43 arvostelua)

Hey, how’s it going? My name is Mike, I’m a Web Designer & Developer from Boston. I've had a look at your project description and feel that my skills match your requirements perfectly. Relevant Skills and Experience G Lisää

$277 USD 3 päivässä
(7 arvostelua)

final Relevant Skills and Experience To achieve goal with 100% quality we have team of 15 Professional Software Engg/Developer. Proposed Milestones $277 USD - by delivering work of the highest quality on-time and on- Lisää

$277 USD 3 päivässä
(5 arvostelua)

Hello Client, Hope you are doing well ! I would like to take a chance to show my abilities and prove that I am a right candidate for this [login to view URL] more then 8 years of experience in,Python,Scraping,Crawlingand Sc Lisää

$250 USD 0 päivässä
(5 arvostelua)

Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now Relevant Skills and Experience I can scrape any website using any technolog Lisää

$277 USD 3 päivässä
(7 arvostelua)
$277 USD 3 päivässä
(7 arvostelua)

Dear Hiring Manager: I am quite excited to apply for the job posting of a Web Designer. Relevant Skills and Experience Since I am a well qualified contractor who would be an excellent choice for this job. Proposed Mi Lisää

$274 USD 2 päivässä
(11 arvostelua)

I checked your website and document details and yes will get your long along with I can do this work fast and deliver you soon. Relevant Skills and Experience I am having 6 year PHP and Wordpress and javascript and jq Lisää

$333 USD 3 päivässä
(1 arvostelu)

Hello, I am a developer, web designer and computer programmer offering over +5 years of experience on both client and server sides. I work quickly and quality is my top priority. I am perfectly capable of following i Lisää

$250 USD 20 päivässä
(2 arvostelua)