Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup

Suljettu Julkaistu kuukausi sitten Maksettu toimituksen yhteydessä

We are currently facing challenges in scraping specific components from our Magento website. Our existing setup utilizes BeautifulSoup and Selenium, but we're encountering difficulties in accurately identifying the target components, such as image cards, tables, etc., based on predefined criteria. The main issue stems from the complexity of the website's structure, where the code primarily consists of divs, and the JavaScript and CSS are heavily compressed.

This complexity has led to a situation where adjustments made to the scraping logic work on some pages but fail or scrape incorrect data on others. With a vast website encompassing thousands of pages, manual adjustments are not feasible and often lead to a breakdown in other parts of the site.

We are looking for a skilled freelancer who can implement advanced techniques, potentially involving machine learning, to enhance our web scraping capabilities. The primary task will be to develop a system that can intelligently identify or tag complex web components that are currently challenging to scrape. This system should adapt to the diverse structures of different pages and reliably extract the required data.

Key Responsibilities:

Analyze the current web scraping setup and identify the key challenges in extracting specific components.

Develop and integrate a solution, possibly using machine learning, to accurately identify and tag complex web components.

Ensure that the solution is scalable and can handle thousands of pages with varying structures.

Conduct thorough testing to ensure accuracy and efficiency in data extraction across all pages.

Collaborate with our team to integrate the solution into the existing web scraping framework.

Required Skills and Qualifications:

Proven experience in web scraping, particularly with BeautifulSoup and Selenium.

Strong background in machine learning, with the ability to apply ML techniques to web scraping.

Familiarity with Magento websites and their structure.

Excellent problem-solving skills and attention to detail.

Ability to work independently and deliver effective solutions within deadlines.

Tietojen kaavinta verkosta Python Machine Learning (ML) Keinoäly

Projektin tunnus: #37773575

Tietoa projektista

47 ehdotusta Etäprojekti Aktiivinen 2 viikkoa sitten

47 freelanceria on tarjonnut keskimäärin $13/tunti tähän työhön


Hi, I am Senior Python script developer with 10 years of experience. I can scrape your required website by python script/bot with your instructions very short time. Can we discuss please? Thanks

$12 USD / tunti
(176 arvostelua)

Hi Good morning , I have read the brief details on your job listing . I see you have been looking for someone experienced with Machine Learning (ML), Artificial Intelligence, Web Scraping and Python. Its been 8 years s Lisää

$25 USD / tunti
(15 arvostelua)

Hello! Experienced Web Scraping Specialist adept in advanced techniques, specializing in Magento websites. Proficient in Machine Learning integration and skilled in BeautifulSoup for precise data extraction. Elevate yo Lisää

$12 USD / tunti
(268 arvostelua)

Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python and etc. I hav Lisää

$9 USD / tunti
(44 arvostelua)

✅ Advanced Magento Web Scraping Specialist - Enhancing Your Data Extraction! ⭐⭐⭐⭐⭐ Hi there, Hope you are doing well. I've reviewed your project requirements and noticed you're looking for an expert to enhance web scra Lisää

$15 USD / tunti
(30 arvostelua)

Hi there, I understand, you are trying to scrap data from magento website using selenium and beautifulsoup but due heavy use of javascript your existing python script is not working for few pages or few fields. Aft Lisää

$8 USD / tunti
(67 arvostelua)

As a seasoned full-stack web and mobile developer with an extensive experience in building complex applications, specifically with your stack technologies, I believe I can deliver a uniquely effective solution for your Lisää

$10 USD / tunti
(5 arvostelua)

I have read the project requirements for web scraping. Also, if you want to see my past work related to Web Crawler and Scaping, then I will show you. We have 11+ years of experience in software development. We have de Lisää

$20 USD / tunti
(13 arvostelua)

Hello. Thanks for posting. I have just read your description and understood what you want. I am familiar with Python and Web Scraping, Selenium, AI. I am sure I can help you. Please contact me,. Thanks, Maksim

$13 USD / tunti
(4 arvostelua)

Hello there, As a Python developer, I bring advanced skills that align perfectly with your project requirements. I have hands-on experience in developing robust web scraping solutions using BeautifulSoup and Selenium, Lisää

$9 USD / tunti
(16 arvostelua)

Nice to meet you LookingforF, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am c Lisää

$24 USD / tunti
(1 arvostelu)

⭐ Hi, My availability is immediate. I read your project post on Python/Web Scraping/AI/ML Developer. We are experienced full-stack Python developers with skill sets in - Python, Django, Flask, FastAPI, Jupyter Noteboo Lisää

$10 USD / tunti
(12 arvostelua)

Hello I’ve carefully checked your requirements and really interested in Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup . I am confident for your project because I Lisää

$20 USD / tunti
(1 arvostelu)

Yes I have read your project and understood requirements but have some doubts. please message me so we can discuss in detail. i am ready to start work.

$7 USD / tunti
(6 arvostelua)

Hi, there, My name is Amar. My expertise lies in data parsing, extraction, and transformation using Python, including extensive knowledge of BeautifulSoup, Playwright, Pyppeteer and Selenium - tools that are instrument Lisää

$10 USD / tunti
(1 arvostelu)

Hutch-e-lul-lul-o Solution: As an advanced web scraping specialist, I understand the challenges you are facing with scraping components from your Magento website. In order to solve these challenges and improve the a Lisää

$20 USD / tunti
(6 arvostelua)

As an experienced Python developer skilled in Machine Learning (ML) and Web Scraping, I believe I possess the unique set of skills necessary to tackle this complicated project. I've worked extensively with BeautifulSou Lisää

$6 USD / tunti
(3 arvostelua)

Using Python, Web Scraping has become a passion and core strength of mine - enabling clients to extract the data they need in a fast, effective and accurate manner. Specifically, I have utilized BeautifulSoup and Selen Lisää

$6 USD / tunti
(5 arvostelua)

Hello, client. I read your requirement. I'm a developer with years of experience in scraping and web development. During this time, I gained experience in scraping several kinds of websites. One of my projects involv Lisää

$9 USD / tunti
(1 arvostelu)

Hello, I checked out your project " Advanced Web Scraping Specialist Needed for Magento Website with Machine Learning and BeautifulSoup ", and I'm confident Ninja Studio can knock it out of the park for you! With o Lisää

$10 USD / tunti
(0 arvostelua)