
Closed
Posted
I need a robust script or small pipeline that pulls fresh data from a set of e-commerce sites once a week. Each run should capture product details and prices, customer reviews, plus any sales or promotional information that is live on the site at the moment of scraping. My priority is accuracy and consistency: the scraper must handle pagination, variant listings and occasional layout changes without manual fixes, and it should respect each site’s [login to view URL] while rotating user-agents or proxies to avoid blocks. Python with Scrapy, Selenium, BeautifulSoup or Playwright is perfectly fine—use whatever you are most efficient with, provided the solution runs headless and can be triggered by a simple cron job or cloud function. For every weekly crawl I expect two outputs: • A clean CSV or JSON file containing the raw data (product fields, full pricing breakdown, review text & rating, active promo codes or banners). • A short comparative report that highlights price changes, new or expired promotions, and shifts in review volume since the previous run. Acceptance criteria 1. Script scrapes the three requested data categories reliably across my chosen e-commerce sites. 2. Output schema stays identical from week to week. 3. Differential report clearly shows what changed. 4. Full, well-commented source code and a short setup guide are provided so I can redeploy or expand the job myself. Please tell me which tools or libraries you intend to use, any similar e-commerce scraping work you’ve done, and how quickly you can deliver an initial working version. I’m ready to move forward immediately.
Project ID: 40749700
172 proposals
Remote project
Active 1 min ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
172 freelancers are bidding on average $14 USD/hour for this job

Hello, I am Dr. Rajesh Rolen, PhD in Computer Science & Engineering, with experience of over 20+ years in PHP, JavaScript, Web Scraping, Selenium, Python As a preferred freelancer in the top 1%, I have done 400+ projects here on freelancer.com, I have 4.9 ratings out of 5 on average, which showcases my quality of work and timely delivery. Key Highlights: - Free Hosting Support on the Cloud or any desired platform. - Free 3 months of post-delivery support to ensure that our client doesn’t face any challenges after the launch of the project. - Free Dedicated tester on projects to ensure quality delivery, so clients don’t need to act as a tester. - 10+ Years experience UI/UX team to ensure intuitive UI. Portfolio: https://www.freelancer.com/u/Microlent Please open the chat and send me a message, so we can have a more detailed discussion about the project to give you the project timeline and cost. Thank you for considering my services. I look forward to engaging in a productive conversation and understanding how I can be of assistance in bringing your project to life. Regards Rajesh Rolen
$12 USD in 40 days
9.4
9.4

Hello, You shouldn’t have to manually check competitor stores every week to decide when to adjust pricing, respond to new promotions, or identify changing customer interest. I can automate that process and give you the data needed to make those decisions quickly. I’d build a Python pipeline with Scrapy + Playwright for dynamic pages, pagination, variants, pricing, reviews, and promotions, while respecting robots.txt. Each crawl delivers clean CSV/JSON data + a comparative report showing price changes, new/expired promotions, and review-volume shifts. You’ll get well-commented code and setup documentation. I can deliver a working first version within 4-5 days once I have the site details. Best, Niral
$15 USD in 40 days
8.1
8.1

Hi There, Hope you are well. I specialize in web scraping using Python with Scrapy and BeautifulSoup. I have extensive experience in scraping e-commerce sites for product details, prices, reviews, and promotional information. I can deliver a reliable script that meets your requirements in a timely manner. Let's discuss further details to get started. Thanks in advance for the opportunity to working with you. Best Regards, Serazum
$9 USD in 1 day
7.7
7.7

Hello, I can help you with "Automated Weekly E-Commerce Data Scraper" as per your given project description. We can discuss more in detail during a chat conversation when you are available. I've worked on many PHP projects in recent times. So I am confident on achieving your expected Goals. Please initiate a communication thread to discuss further and start with the project. ⭐ 5.0/5 from a recent client: "Good work delievered thank you for your patience" Final timeline and cost will be confirmed in chat after a complete understanding and documentation of the project expectations in detail.
$9 USD in 1 day
7.5
7.5

Hi, I’m Mayank, a full-stack developer with 12+ years of experience in web scraping, automation and e-commerce. I can build the weekly scraper using Python + Playwright/BeautifulSoup, delivering: * Product, pricing, reviews and promotions * Consistent CSV/JSON schema * Automatic week-to-week comparison reports * Error handling and logging * Clean source code + setup guide I can provide the first working version in 3–5 days, depending on the target sites. Send me the three URLs and I’ll confirm the approach. Thanks
$8 USD in 40 days
7.5
7.5

Hello, I'm Denis, a full-stack developer, and I have built data pipelines that scrape e-commerce sites and turn raw product and pricing data into clean, comparable reports week after week. Your goal is to automate collection of product details, prices, reviews and promotions from your chosen sites, then generate weekly reports showing what changed. You need the scraper to handle pagination and layout variations reliably, with consistent output for accurate comparisons. I would start by reviewing your target sites to map data structure and identify anti-scraping measures. Then I would build the scraper using Scrapy or Playwright depending on JavaScript needs, add user-agent rotation and respectful request timing, and write extraction logic for products, prices, reviews and promos. Next I would build the comparison report calculating price deltas and tracking promotion changes, test against live data, and provide full source code and setup guide so you can run or expand it later. The critical part is resilience. Sites change layouts and add blocks, so I would use CSS selectors with fallbacks and add retry logic with exponential backoff. Some sites may block aggressive scraping despite rotation, so we would start with your most accessible site, confirm the approach works, then expand carefully to others while monitoring for blocks. I can start right away. Let's connect and discuss the details. Thanks, Denis.
$15 USD in 40 days
6.7
6.7

Hi, I can build your weekly e-commerce scraper using Python + Playwright/Scrapy, handling pagination, variants, dynamic content, pricing, promotions, and reviews reliably. You’ll receive consistent CSV/JSON outputs plus an automated weekly comparison report showing price, promotion, and review changes. I’ll provide clean, commented code, logging, setup documentation, and cron/cloud deployment support. I can start immediately with the first target sites.
$10 USD in 40 days
6.8
6.8

Hi! My name is Marjan and I'm here to offer you my services as a skilled applicant with over a decade of experience working on Freelancer.com. I believe I am the best fit candidate for this project due to my extensive experience; I would like to have a discussion to get to know that we both are on the same page. Once the scope will be locked, I will start working on it right away.
$20 USD in 40 days
6.8
6.8

Hi, I can have this done for you very fast, check my profiles and reviews. And lets get in contact first.
$15 USD in 7 days
6.0
6.0

Hey, looks like you need a weekly scraper that handles pagination, variant listings, and dynamic promo banners without breaking when layouts shift. I'd build this in Python using Playwright paired with BeautifulSoup for speed, dropping outputs into a clean JSON schema alongside a diff script that flags price shifts and new reviews. Keeping the schema identical week-to-week is the tricky part here, usually solved by strict data validation before writing the files. Should we set the cron job up to run on AWS Lambda or just a standard VPS?
$250 USD in 7 days
6.0
6.0

Hello, I understand you need an automated weekly e-commerce data scraper to collect accurate and updated product information. Problem: Manual data collection is time-consuming and can lead to missing, duplicate or outdated product data. Solution: I will build a reliable Python/Scrapy-based scraper with structured extraction, duplicate handling, error recovery and automated weekly scheduling. Data can be exported to CSV, Excel, database or your preferred format. Result: You’ll have a fully automated system that collects fresh e-commerce data every week with minimal manual effort. I have 20 years of software development experience with strong expertise in Python, Scrapy, web scraping, APIs, databases and automation. Questions: 1. Which websites need to be scraped? 2. Which product fields do you need, and where should the scraped data be delivered? Thanks
$9 USD in 40 days
6.0
6.0

Hi, I understand you're looking for a reliable script to scrape data from e-commerce sites weekly, capturing product details, prices, customer reviews, and promotions. Your emphasis on accuracy and consistency is crucial for maintaining data integrity. The main challenge here lies in handling dynamic content and varying site structures, especially with pagination and layout changes. My approach would involve creating a flexible scraping architecture that can adapt to these changes by using a combination of HTML parsing and dynamic content handling techniques, ensuring minimal manual intervention. I have extensive experience with web scraping using Python and JavaScript, particularly in developing automated pipelines that efficiently manage data extraction from complex sites. Q1 – Could you specify the number of e-commerce sites and their URLs? Q2 – Are there any specific data fields or formats you need for the output? Q3 – How should the script handle failed attempts or errors during a scrape? Looking forward to hearing from you.
$8 USD in 7 days
6.0
6.0

==== Hi - Truong here ==== "AUTOMATED E-COMMERCE DATA SCRAPER" - you need weekly product tracking without manual data cleanup. I would build the scraper with Python using Scrapy and add Playwright or Selenium only where websites need browser rendering. The key part is keeping one stable data format while handling pagination, variants, and small layout changes. I would store each crawl result, compare it with previous runs, and generate reports showing price, promotion, and review changes. Do you already have the three target websites selected, and do they require login access for any product data? Looking forward to work with you.
$12 USD in 40 days
5.5
5.5

Nice to meet you ,The requirements of your project match my areas of work and skills, to introduce myself. My name is Anthony Muñoz and i am the lead engineer for DS Pro IT agency. I have worked for over 10 years as a Full-Stack and software development engineer and have successfully done multiple jobs. It will be a pleasure to work together to make your project. Feel free to discuss about the project with me, greetings.
$14 USD in 40 days
5.9
5.9

I focus on resilient scraping architectures that survive layout shifts, aligning perfectly with your need for consistent weekly data. My DocuMind AI project utilized Python and FastAPI to build robust pipelines handling complex data structures and automated processing. You can view similar engineering work at usmanahmed-dev.vercel.app. Which specific e-commerce sites are on your list, and do you prefer a local cron setup or a cloud function deployment? I will use Playwright for dynamic rendering combined with a custom differential engine to generate your JSON outputs and change reports. I can deliver a fully commented, working prototype within 48 hours. Let’s start building this reliable data pipeline today.
$12.74 USD in 7 days
5.3
5.3

Hi, I can build this in Python. I’d probably use Scrapy/BeautifulSoup for regular pages and Playwright only for sites where the product or review data is loaded dynamically. I’d keep a consistent data schema for products, variants, prices, reviews and promotions, then store each weekly snapshot so the next run can compare against it and report price changes, new/expired promotions and changes in review counts. Pagination and variants would be handled per site rather than relying on one generic scraper. I can also make the request rate, user-agent/proxy settings and scheduling configurable, while respecting the crawling rules you mentioned. The job can run headless from cron, and each run will produce CSV/JSON plus the change report. I work mainly with Python backend and data-processing systems and have experience with scraping/API-based data collection as well. I can have the first working version ready in a few days once I see the target sites. The exact estimate depends on how many sites there are and whether they use static pages, APIs or JS rendering. Thanks, Albert
$10 USD in 20 days
4.8
4.8

Missing a promo or price drop because your scraper missed a change costs you real sales. You get a weekly dataset that always matches your schema and a report that flags every product or promo change, no surprises. First I confirm the exact e-commerce sites and data fields you care about. Then I build the Python scraper with Scrapy and Playwright, handling pagination, variants and rotating agents so you don’t get blocked. You get clear code, a setup guide and a sample run so you can rerun or expand it anytime. You’ll have a clean handover so you can run or tweak it yourself, no hidden steps. Which three sites do you want scraped first?
$15 USD in 40 days
4.9
4.9

Hello, I checked your project "Automated Weekly E-Commerce Data Scraper" and already have a clear understanding of your requirements and how to deliver them efficiently. I have solid experience in PHP, JavaScript, Python, and I've successfully completed similar projects by delivering high-quality, scalable, and reliable solutions. Why choose me? * Strong expertise in PHP, JavaScript, Python * Clean, optimized, and scalable implementation * Fast communication and regular progress updates * Focused on delivering results, not just completing the task I'm ready to start immediately and would be happy to discuss the details. Best regards, Umer
$9 USD in 40 days
4.5
4.5

Hi, Your requirement for a weekly automated pipeline to scrape product details, reviews, and promotions aligns with my experience building robust, scalable scraping and ingestion systems like the DocIntel AI platform. The main technical risk here is ensuring scraping reliability and data consistency despite frequent site layout changes and anti-bot measures. I contributed to designing a fully automated scraping and ingestion pipeline using Playwright that handled dynamic content and pagination while maintaining schema consistency across runs. This experience directly translates to building your weekly e-commerce scraper with accurate differential reporting. I typically design scraping architectures with separate ingestion, data validation, and reporting layers to isolate failures and enable easier maintenance. Early validation of layout change detection and proxy rotation effectiveness will be key to long-term stability. For reliability, I emphasize retries, schema validation, and monitoring to detect scraping failures or data drift early, reducing manual intervention and ensuring consistent outputs. I can start by outlining the ingestion architecture and differential report workflow to align on key technical milestones. Thanks, Clifton
$25 USD in 40 days
4.6
4.6

Hi, I can build a Python pipeline with site-specific parsers, a stable CSV/JSON schema and weekly snapshots for comparing prices, promotions and review counts. I would validate required fields and report parser failures rather than silently produce incomplete data. Robots rules and access restrictions must be respected; arbitrary layout changes cannot be guaranteed maintenance-free. My rate is $15/hour; an initial single-site version is roughly 12–20 hours after checking access. I do not have a matching public case study. Which sites and product volumes should the first release cover?
$15 USD in 20 days
4.7
4.7

Aga, Egypt
Member since Oct 3, 2026
$250-750 USD
$30-250 USD
$15-30 USD
$10-30 USD
$15-25 USD / hour
$10-30 USD
$200-300 AUD
$30-250 USD
$250-750 USD
$8-15 USD / hour
$15-30 USD
$15-25 USD / hour
$30-250 USD
$1500-3000 USD
$15-30 USD
€12-18 EUR / hour
$30-250 USD
$10-30 USD
₹12500-37500 INR
£10-15 GBP / hour