Data fetching / analysis from a public ecommerce online platform

I need a web crawler program to get the information for a public online ecommerce platform.

- select category or sub-categories of ecommerce platform (continuous update, allow add or delete)

- input brands to be ignored (continuous update, allow add or delete)

- run the program 7x24 with standard notebook computer

- go through each listing one by one (by program in backend)

- record down the sales quantity (to be found out by program, as online platform will not report the data)

The most time consuming method (manual) is to click individual listing every day, check the inventory available for sale (by buying maximum quantity in shopping cart if no inventory data is available), and compare with previous day.

- record all sales quantity for each listing (if quantity is different)

- output and update to an excel file 1 by 1, and save the complete record of each category (after complete the category) in Google cloud in addition saving the file in PC.

- product name (with http link back to product listing), quantity sold yesterday, quantity sold last 7 days, quantity sold last 30 days, total no. of visit

- unit price, no. of sellers, brand name, seller status, image thumb nail

- sort by highest quantity sold, brand name, unit price.

The program shall re-start automatically if there is the server is down, loss of internet connection etc.

Getting the inventory of a listing is the most time consuming.

How to update and store the data is most challenging as the listing position in web site is changing every second. The output excel file has to store 31 days data.

Online ecommerce platform does not have any support nor API.

The program shall be able to run in Windows 10 (both English and Chinese version). It is recommended the browser to use internet explorer as the computer has other program running with Google Chrome. if developer can ensure no conflict, it is OK to use Google chrome (e.g. incognito mode).

Interested parties please send a detail quotation - time and cost. Debugging is the most time consuming.

Deliverable shall be an executable program, which I can download from Google cloud. No teamviewer etc. installation.

Automatic or chat bot response will not be considered.

Interested party please contact for the name of public ecommerce site.

Applicant shall prove he can do the program by providing a sample excel file extracted from captioned web site.

Taidot: PHP, tietojärjestelmäarkkitehtuuri, MySQL, Tietojen kaavinta verkosta, Javascript

Näytä lisää: data fetching, data mining analysis using spss online bid freelance, data research analysis reports, data processing analysis methods business, analysis report ecommerce website, analysis design ecommerce site, project data processing analysis writting reort software spss, ways data presentation analysis, php html data fetching, set data meta analysis spss, government statistic data survey analysis sas, white pages data fetching program, api call excel online data, call data record analysis, data presentation analysis project, data technical analysis, online data fetching, software fetch data online platform using oauth

Tietoa työnantajasta:
( 2 arvostelua ) Kowloon, Hong Kong

Projektin tunnus: #22767959

24 freelanceria on tarjonnut keskimäärin 532$ tähän työhön


Hi Can you provide the site and sample of the proposed output file? Thanks

$1000 USD 7 päivässä
(222 arvostelua)

HI, I can assist you with ecommerce online platform . Here is a sampling of the few of my work contained at my portfolio: This is a placehoolder bid, I would be able to quo Lisää

$500 USD 7 päivässä
(87 arvostelua)

Hi,dear! I am quite interested in your project - 'Data fetching / analysis from a public ecommerce online platform'. :) I've already done this kind of project before. I am a skillful software developer who has rich exp Lisää

$555 USD 2 päivässä
(22 arvostelua)

Hello Sir, I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without cha Lisää

$500 USD 10 päivässä
(91 arvostelua)

Hello Just to introduce myself, I have more than 7 years of experience in full-stack development. Now coming on this project I have gone thru the details and I am very much interested to work with you. Please provid Lisää

$500 USD 7 päivässä
(39 arvostelua)

Hello I have gone through your requirements in detail. I am a web expert having great experience in Ajax, JAVASCRIPT, CSS, Jquery, Html. I will provide you the website as per your requirements where you can easily ma Lisää

$555 USD 11 päivässä
(32 arvostelua)

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON Lisää

$250 USD 3 päivässä
(84 arvostelua)

Hello Sir, I hope you are fine. Web development is my passion. I have 5 years of experience in the field of web development. Expertise in HTML 5, CSS 3 , PHP, MySQL, Java Script, JQuery, WordPress, Theme Customize an Lisää

$900 USD 30 päivässä
(52 arvostelua)

I am a Scraping expert. I am sure I can get the all requirements without any problems. I will wait your reply.

$700 USD 7 päivässä
(31 arvostelua)

Hello, What is the website ? I hope it's not aliexpress or taobao .......... **************************************************************************

$688 USD 14 päivässä
(17 arvostelua)

Your ideal candidate has : - Fluent English skills to have a call with you at any time you want. - Punctual attitude to the seriously set timeline. - Proven skills and experiences with PHP and javascript along with Lisää

$500 USD 7 päivässä
(4 arvostelua)

Hi, When we can talk please schedule a time? I will work till satisfaction of you and do work more perfectly and clearly. Please have a check Website designing and development work work below [login to view URL] Lisää

$500 USD 7 päivässä
(5 arvostelua)

Dear sir I have already developed many ionic/Hybrid Mobile apps in our experience and I'm sure did develop apps similar to your requirement in the past. We are a professional expert team of 20 Android, IOS & Web devel Lisää

$500 USD 7 päivässä
(5 arvostelua)

Hi,sir. MY name is carl [login to view URL] I have read your project description carefully. $I am a PHP scraper expert experienced with the your project. I am graduated from a technical university. &I think that your project is Lisää

$250 USD 3 päivässä
(3 arvostelua)

Hello, thanks for your kindly attention .......just i am for your project..... i have read your project in detail in your project first is website info scraping and the second is storing and sorting it in principle of Lisää

$250 USD 3 päivässä
(6 arvostelua)

I have a ready-made crawler framework, just add your URL to my system. You told me that those elements of the page need to be extracted and the system will extract them automatically. So I can do it for you quickly. I Lisää

$600 USD 2 päivässä
(0 arvostelua)

Ok, I can do it, I have a project crawler engine by .NET Google sheet. Please message me then I can show you how to it run. Time is money, short talk and start work if ok! Thanks!

$500 USD 7 päivässä
(0 arvostelua)

PROFESSIONAL ECOMMERCE ELECTRONICS WEBSITE -- CHAT NOW Hello, Does quality matter? I’m Imran Jelani I promise to do a great job on your ecommerce website! I’m a PRO Web Designer / PHP Expert. I’m new here but WELL es Lisää

$299 USD 4 päivässä
(0 arvostelua)

"I need a web crawler program to get the information for a public online ecommerce platform. - select category or sub-categories of ecommerce platform (continuous update, allow add or delete) - input brands to be ignor Lisää

$500 USD 7 päivässä
(0 arvostelua)

Hi, Hope you are doing good. I have gone through your requirement and I do have skill set you are looking for. I have expertise in scrapping as well, refer below links shared for review from seller. I am certified a Lisää

$555 USD 3 päivässä
(0 arvostelua)