Daily Trending Products Detection Program

Suljettu Julkaistu 3 kuukautta sitten Maksettu toimituksen yhteydessä
Suljettu Maksettu toimituksen yhteydessä

The goal of this project is to develop a program that can identify trending products on a daily basis from specific e-commerce websites (the list will be provided later). The program should retrieve relevant product data, analyze it to identify trending products, and then output the results in a useful and structured format.

**Key Responsibilities**:

1. **Data Acquisition**: You are responsible for developing a system that retrieves product data from the provided list of e-commerce websites. This may involve web scraping or API integration, depending on what each platform allows and provides. Python, with libraries such as BeautifulSoup and requests for web scraping, or requests alone for API integration, is our preferred language for this task.

2. **Data Analysis**: The program should analyze the retrieved data to identify trending products. A product's trendiness can be determined by factors such as a high number of recent sales, a spike in social media mentions, or a rapid climb in the sales rank. Tools like pandas, NumPy, or SciPy in Python can be used for this task.

3. **Automation**: This entire process needs to run automatically on a daily basis. Depending on the deployment environment, this can be accomplished by setting up a cron job, using a task scheduler, or other methods.

4. **Output**: The program should output the results in a clear and structured format. This should be a CSV file, a JSON file, and a database.

5. **Error Handling and Logging**: It's crucial to handle potential errors gracefully so the program can recover or, at the very least, log the error for troubleshooting. Logging mechanisms need to be implemented throughout the program.

**Required Skills**:

1. Python programming

2. Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc.

3. Experience with API integration

4. Data analysis and manipulation with pandas, NumPy, or similar libraries

5. Task automation and scheduling

6. Logging and error handling

7. Familiarity with JSON, CSV, or databases for data storage and output


1. Source code of the program.

2. Documentation detailing how to run, maintain, and troubleshoot the program. The documentation should also describe the data flow, and explain the logic behind how trending products are determined.

3. A sample output of the program.

**Additional Notes**:

1. All web scraping should respect the target website's terms of service and [login to view URL] files, and comply with all relevant laws and regulations.

2. While developing, always consider the load you're putting on the target websites and design your program in such a way that it minimizes the potential disruption.

3. Ensure the program is designed with scalability and maintainability in mind.

4. Communication is key. Regular progress updates are expected.

tiedonlouhinta PHP Python Tietojärjestelmäarkkitehtuuri Tietojen kaavinta verkosta

Projektin tunnus: #36706095

Tietoa projektista

25 ehdotusta Etäprojekti Aktiivinen 2 kuukautta sitten

25 freelanceria on tarjonnut keskimäärin $595 tähän työhön


Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP and Python are my majors, so Lisää

$750 USD 7 päivässä
(196 arvostelua)

Hello, With over 10 years of industry experience, I offer expertise in web scraping, Python programming, and data mining. I specialize in efficiently extracting data from websites, automating data collection processes Lisää

$900 USD 10 päivässä
(76 arvostelua)

I'm a senior Python & ML developer and owner & founder of Dedeoglu Dev Company. Kindly send me a message to get in touch with me, Thanks, Yusuf

$500 USD 7 päivässä
(26 arvostelua)

<<< السلام عليكم >>> I'm sure that I can help you. I'm artificial intelligence engineer experienced in Data Science, Machine/Deep Learning for more 9 years. Feel free to contact me for further details because I am l Lisää

$850 USD 7 päivässä
(30 arvostelua)

Hello there! My name is Ali and I'm a Web Developer, App Developer and Graphic Designerr with 10 years of professional working experience. I understand that you are looking for a program that can identify trending prod Lisää

$500 USD 7 päivässä
(11 arvostelua)

Greetings, I have gone through your project description. I find myself as a perfect fit for this job. I am working as a Python Developer from last 2 year. Some of my expertise is in the fields: 1. Web Scraping/Web Au Lisää

$250 USD 2 päivässä
(74 arvostelua)

Hi, i have already worked on similar jobs. using python scrapy and/or selenium, i will develop a bot that would go through the eCommerce websites collecting products with relative data to help us determine the trendi Lisää

$450 USD 5 päivässä
(16 arvostelua)

Hi there! My name is Salman ullah, and I'm a freelance developer with expertise in Python, machine learning, and Django. I've worked on a wide variety of projects throughout my career, which has given me firsthand expe Lisää

$500 USD 7 päivässä
(7 arvostelua)

Results-oriented, meticulous and innovative and experienced Web, software developer and automation engineer with expertise in systems analysis, Web site design, and application integration. Ability to increase reliabi Lisää

$500 USD 25 päivässä
(15 arvostelua)

I understand you are looking for a program that can identify trending products on a daily basis from specific e-commerce websites. Python with the libraries such as BeautifulSoup and Requests would be my best choice fo Lisää

$300 USD 2 päivässä
(3 arvostelua)

Hello, sir! I'm a python(Django, Flask) development expert with 8+ years experience and I'm very familiar with web scraping and data mining using BS4, selenium, Data Scraping, Data Entry and undetectable chrome driver Lisää

$500 USD 7 päivässä
(3 arvostelua)

Hi Mate, Surely I can help you in creating a program that will identify trending products on a daily basis from specific e-commerce websites. The program will retrieve all relevant product data, analyze it to identif Lisää

$500 USD 7 päivässä
(1 arvostelu)

Experienced freelancer in SolidWorks, logo design, programming, and scriptwriting. I offer expertise in these areas and deliver high-quality results. Let's work together to bring your project to life. Contact me now! # Lisää

$250 USD 2 päivässä
(0 arvostelua)

Hello there! My name is Bala Niranchan, and I'm a data science specialist with a strong background in Python, machine learning algorithms, deep learning algorithms, statistics, data analytics, natural language processi Lisää

$500 USD 7 päivässä
(0 arvostelua)

Hello, my name is Soham and I am an accomplished data analyst with 4 years of experience in the field. I specialize in transforming raw data into valuable insights that drive strategic decision-making. As a part of my Lisää

$300 USD 7 päivässä
(0 arvostelua)