Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup

Suljettu Julkaistu kuukausi sitten Maksettu toimituksen yhteydessä
Suljettu

We are currently facing challenges in scraping specific components from our Magento website. Our existing setup utilizes BeautifulSoup and Selenium, but we're encountering difficulties in accurately identifying the target components, such as image cards, tables, etc., based on predefined criteria. The main issue stems from the complexity of the website's structure, where the code primarily consists of divs, and the JavaScript and CSS are heavily compressed.

This complexity has led to a situation where adjustments made to the scraping logic work on some pages but fail or scrape incorrect data on others. With a vast website encompassing thousands of pages, manual adjustments are not feasible and often lead to a breakdown in other parts of the site.

We are looking for a skilled freelancer who can implement advanced techniques, potentially involving machine learning, to enhance our web scraping capabilities. The primary task will be to develop a system that can intelligently identify or tag complex web components that are currently challenging to scrape. This system should adapt to the diverse structures of different pages and reliably extract the required data.

Key Responsibilities:

Analyze the current web scraping setup and identify the key challenges in extracting specific components.

Develop and integrate a solution, possibly using machine learning, to accurately identify and tag complex web components.

Ensure that the solution is scalable and can handle thousands of pages with varying structures.

Conduct thorough testing to ensure accuracy and efficiency in data extraction across all pages.

Collaborate with our team to integrate the solution into the existing web scraping framework.

Required Skills and Qualifications:

Proven experience in web scraping, particularly with BeautifulSoup and Selenium.

Strong background in machine learning, with the ability to apply ML techniques to web scraping.

Familiarity with Magento websites and their structure.

Excellent problem-solving skills and attention to detail.

Ability to work independently and deliver effective solutions within deadlines.

Tietojen kaavinta verkosta Python Machine Learning (ML) Keinoäly

Projektin tunnus: #37773575

Tietoa projektista

47 ehdotusta Etäprojekti Aktiivinen 2 viikkoa sitten

47 freelanceria on tarjonnut keskimäärin $13/tunti tähän työhön

imtyzooel71n

Hi, I am Senior Python script developer with 10 years of experience. I can scrape your required website by python script/bot with your instructions very short time. Can we discuss please? Thanks

$12 USD / tunti
(176 arvostelua)
7.6
AwaisChaudhry

Hi Good morning , I have read the brief details on your job listing . I see you have been looking for someone experienced with Machine Learning (ML), Artificial Intelligence, Web Scraping and Python. Its been 8 years s Lisää

$25 USD / tunti
(15 arvostelua)
7.0
uumarkhalid31

Hello! Experienced Web Scraping Specialist adept in advanced techniques, specializing in Magento websites. Proficient in Machine Learning integration and skilled in BeautifulSoup for precise data extraction. Elevate yo Lisää

$12 USD / tunti
(268 arvostelua)
7.3
sajjadtaghvaeifr

Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python and etc. I hav Lisää

$9 USD / tunti
(44 arvostelua)
6.8
ZohaibRoy

✅ Advanced Magento Web Scraping Specialist - Enhancing Your Data Extraction! ⭐⭐⭐⭐⭐ Hi there, Hope you are doing well. I've reviewed your project requirements and noticed you're looking for an expert to enhance web scra Lisää

$15 USD / tunti
(30 arvostelua)
5.6
asifkhan268

Hi there, I understand, you are trying to scrap data from magento website using selenium and beautifulsoup but due heavy use of javascript your existing python script is not working for few pages or few fields. Aft Lisää

$8 USD / tunti
(67 arvostelua)
5.8
abhisaini0188

As a seasoned full-stack web and mobile developer with an extensive experience in building complex applications, specifically with your stack technologies, I believe I can deliver a uniquely effective solution for your Lisää

$10 USD / tunti
(5 arvostelua)
5.3
vorasiddh4it

I have read the project requirements for web scraping. Also, if you want to see my past work related to Web Crawler and Scaping, then I will show you. We have 11+ years of experience in software development. We have de Lisää

$20 USD / tunti
(13 arvostelua)
5.1
maksabakanovich

Hello. Thanks for posting. I have just read your description and understood what you want. I am familiar with Python and Web Scraping, Selenium, AI. I am sure I can help you. Please contact me,. Thanks, Maksim

$13 USD / tunti
(4 arvostelua)
4.2
narukaconsultan5

Hello there, As a Python developer, I bring advanced skills that align perfectly with your project requirements. I have hands-on experience in developing robust web scraping solutions using BeautifulSoup and Selenium, Lisää

$9 USD / tunti
(16 arvostelua)
3.8
dataspro

Nice to meet you LookingforF, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am c Lisää

$24 USD / tunti
(1 arvostelu)
3.8
malkesh3m

⭐ Hi, My availability is immediate. I read your project post on Python/Web Scraping/AI/ML Developer. We are experienced full-stack Python developers with skill sets in - Python, Django, Flask, FastAPI, Jupyter Noteboo Lisää

$10 USD / tunti
(12 arvostelua)
3.9
siedovyehorrr32

Hello I’ve carefully checked your requirements and really interested in Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup . I am confident for your project because I Lisää

$20 USD / tunti
(1 arvostelu)
3.0
Minakshi0925

Yes I have read your project and understood requirements but have some doubts. please message me so we can discuss in detail. i am ready to start work.

$7 USD / tunti
(6 arvostelua)
3.0
amarmUK

Hi, there, My name is Amar. My expertise lies in data parsing, extraction, and transformation using Python, including extensive knowledge of BeautifulSoup, Playwright, Pyppeteer and Selenium - tools that are instrument Lisää

$10 USD / tunti
(1 arvostelu)
3.0
giaphung2k1

Hutch-e-lul-lul-o Solution: As an advanced web scraping specialist, I understand the challenges you are facing with scraping components from your Magento website. In order to solve these challenges and improve the a Lisää

$20 USD / tunti
(6 arvostelua)
2.6
shubhamkhera144

As an experienced Python developer skilled in Machine Learning (ML) and Web Scraping, I believe I possess the unique set of skills necessary to tackle this complicated project. I've worked extensively with BeautifulSou Lisää

$6 USD / tunti
(3 arvostelua)
2.7
larsenm2020

Using Python, Web Scraping has become a passion and core strength of mine - enabling clients to extract the data they need in a fast, effective and accurate manner. Specifically, I have utilized BeautifulSoup and Selen Lisää

$6 USD / tunti
(5 arvostelua)
2.6
branislav2323

Hello, client. I read your requirement. I'm a developer with years of experience in scraping and web development. During this time, I gained experience in scraping several kinds of websites. One of my projects involv Lisää

$9 USD / tunti
(1 arvostelu)
2.6
MoannaLTD

Hello, I checked out your project " Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup ", and I'm confident Ninja Studio can knock it out of the park for you! With o Lisää

$10 USD / tunti
(0 arvostelua)
0.0