Python web scraping to database työt
Dataset + python + finance concepts
...experienced web scraper who can extract data efficiently from multiple websites. Applicants' guidelines are as follows: 1. Websites for Scraping: Due to security concerns, the websites to be scraped will only be shared with the selected freelancer. 2. Application Contents: I didn't explicitly mention what I want freelancers to include in their applications. However, demonstrating your skills, experience, and past work related to web scraping will surely be a significant advantage. 3. Project Deadline: I require this project to be completed as soon as possible. Please include your estimated completion date in your proposal. Ideal Skills & Experience: - Proven experience in web scraping - Knowle...
I need a proficient Linux developer with a solid understanding of networking and security, and expertise in scripting languages like Bash or Python. The primary task will be troubleshooting and optimizing existing Linux systems. Also, superior skills in server administration and deployment are a requisite for this role. As the project unfolds, communication is critical, but I haven't decided on a reporting frequency at this point. Please provide suggestions on what you've found effective in your experience.
...CONDITION) I need a skilled frontend developer to create basic HTML/CSS pages. You will need to integrate these frontend pages with a Python backend. The project involves adding JavaScript for client-side validation and implementing AJAX page transitions. After pressing the 'save' button on one of the pages, the page should transition to the next. The data inputted should be sent to the Python backend for processing. Key Requirements: - Proficient in HTML, CSS, and JavaScript - Experience with client-side validation and AJAX - Prior work experience that showcases your frontend development skills - Proficiency in Python is a must for the backend implementation Please provide me with your relevant past work when you apply for th...
Hello, i have python codes that fetchs some data.i need someone have experience in qt designer to create the win form To show the data as required some in lables and some tables and need the design visually so we can easly edit in future Will explain the required design privately sharescreen in anydesk..
for taking BLS algeria appointments for spain visa fast and easy
I need a market research-oriented individual with an expertise in data mining and web scraping. The project entails extracting data from the website harborfreight.com. Specifically detailing: - Product names - Product price - Product type (IE power tools) - Their associated number of customer ratings These details should provided in a CSV file then be categorized by product type. A strong understanding of categorization and proficiency in scraping complex websites will be beneficial. With this data, I intend to carry out detailed market research. Do not worry about descriptions, focus solely on the product names, price, rating numbers, and categorization. I'm looking forward to seeing your proposals if your skills align with these needs.
I'm in need of a skilled developer to create an intelligent transaction monitoring platform with big data capabilities, specifically focusing on real-time monitoring and fraud detection. Key Features: - The system should support real-time monitoring of transaction data. - It should have fraud detection capabilities. - Data visualization to aid in tracking and analysis. - Analytics for evaluating transaction patterns and identifying potential issues. - Smooth Data Pipeline with Realtime streaming for efficient data handling. - API integration with third parties to ensure seamless operation. Target Audience: This platform is primarily aimed at banking and financial institutions, as well as e-commerce companies. Preferred Technology Stack: - Java & Python...
I need assistance in creating a Python script that can dial a number through a VoIP service using the VCDial setup I have. The code should also play a pre-recorded message when the call is connected. The operating system I am using is Windows. Key Requirements: - Develop a Python script that can interact with the VCDial setup for dialing numbers. - Integrate the functionality to play a pre-recorded message once the call connects. - Ensure the script can run smoothly on a Windows environment. Ideal Freelancer: - Proficient in Python programming, with experience in telephony and VoIP setups. - Familiar with VCDial or similar systems. - Able to work effectively on Windows OS. - Prior experience in creating automated call systems or call centers would be a...
Application code to implement Roomio as a web application in python. You will use the table definition posted at the end of this document.
I am looking for an advanced AI expert who is proficient in Python to help me understand and manipulate a developed Python package on a tutoring basis. The link of the package is: I am interested in the cylinder problem here: Key Responsibilities: The tutor should help me to make changes in the code, track the flow of the data, know the dimensions of the data, debug errors that I may encounter, and how to create more figures as well. Level of Expertise: Advanced. It's important that the tutor is proficient in AI and Python, and can guide me through the learning process at an advanced level.
I'm looking for a Python expert to help me set up a pipe network simulation and analyze the pressure data for detecting potential water leaks. The primary goal of this project is to simulate a water pipe network and subsequently identify potential leaks using pressure drop analysis. The simulation should be able to model the flow and pressure properties of a complex network of pipes. Key tasks: - Setting up the pipe network simulation using Python - Conducting pressure drop analysis for leak detection - Providing an intermediate level of detail in the analysis report - this should include the locations and estimated sizes of the potential leaks Ideal candidates for this project should have: - Proven experience in Python programming - Unde...
I need a proficient Python expert to scrape recipes from a designated website to an Excel sheet. The project needs to be completed as soon as possible. You can use this open-source working scraper Key requirements: - Scraping recipe information (name, ingredients, cooking instructions, nutrition facts) from a specific website. - Outputting the scraped data in a well-organized Excel sheet. Ideal skills for this project include: - Proficiency in Python for web scraping. - Familiarity with scraping data from websites. - Excellent organizational and data management skills for outputting the data in Excel. If you can deliver this quickly and efficiently, please feel free to bid.
I am looking for a skilled professional who can design an emulator for Windows platform. This emulator should primarily support the programming language Python, and should be able to cater to users who wish to use Python for completing assignments. Key requirements: - Platform: Windows - Main functionality: Assignment completion tool - Supported programming language: Python Ideal Skills and Experience: - Strong proficiency in software development, particularly in designing emulators - Proficiency in Python programming language - Experience working with Windows platform - Previous experience in developing educational tools or software is a plus
We require an Excel list comprising 500,000 LinkedIn accounts, each including the login email ID (not contact email), name, and company name. The contacts must meet the following criteria: Title: Owner Location: United States Search Keywords: Restaurant, Automotive Repair, Towi...ID (not contact email), name, and company name. The contacts must meet the following criteria: Title: Owner Location: United States Search Keywords: Restaurant, Automotive Repair, Towing, Tire, Jewelry, Pawn, Automotive, Pools, Boutique, Tile, Heavy Equipment, Chiropractic, Boats, Furniture, Lumber, Granite, Stereo, Trailers Project Deadline: Saturday 7:30 PM ( Indian time zone) To confirm your readiness to commence the project, provide me a minimum of 2000 completed rows that meet the specif...
I’m seeking a full stack web developer with proficiency in HTML, CSS, JavaScript, Python, Ruby, PHP, Node.js, and React to create a comprehensive hotel booking website. The primary aim of this project is to offer a user-friendly and efficient space for users to book hotels while enjoying a smooth and seamless experience. Features desired include: - Search functionality to enable effortless hotel discovery - Booking management to track and manage users' bookings - Incorporation of customer reviews to enhance customer confidence and choices - Integration of online payment solutions for smooth financial transactions - A Room availability calendar for easy checking of room availability - Multi-language support to...
I'm uncertain whether my Windows system already has Python installed. I require assistance to get it up on my system, if it isn't already there. Primarily, I am looking for someone to help configure a Python script that will carry out automatic reservations on a specific website. This role will ideally suite someone with: - Proficiency in Python scripting - Strong understanding of automation using Python - Experience in setting up Python on the Windows platform - Knowledge of web interaction through code, in particular, reservation processes. here is the link to the script and its dependencies. I will need to work with you on zoom live to do this. I have node.js on windows
I'm looking for a skilled DevOps Engineer experienced in AWS to help design a robust architecture for my Spark and Sagemaker Machine Learning models. Key Requirements: - **AWS Services**: Your primary focus will be on utilizing Amazon S3 and Amazon Sagemaker effectively within the architecture. - **Programming Languages**: Familiarity with both Python and R is important, given that my models are built in those languages. - **Model Operations**: Your design should focus on enabling batch predictions and facilitate model training and retraining for the Machine Learning models. Ideal Skills: - Experience with Amazon S3 and Amazon Sagemaker are a must. - Proficiency in Python and R for fine-tuning or troubleshooting the models. - Familiarity with designing architect...
I'm on the lookout for skilled blockchain backend developers with proficiency in Python, JavaScript, and Solidity. Your understanding of Ethereum and experience in blockchain will prove to be incredibly valuable. The key features I need you to support in the blockchain backend are smart contracts and the development of decentralized applications (DApps). Ideal Skills and Experience: - Proficient in Python, JavaScript, and Solidity - Experience with Ethereum - Prior work in blockchain development - Knowledge of smart contracts - Proven experience in DApp development Your ability to deliver efficient and secure blockchain backend solutions, that facilitate the execution of smart contracts and the development of DApps, will be crucial for the succes...
I need to create a script to consume a SOAP service with WSSecurity to Encrypt and Sign the XML, an example is the way SOAPUI is configured to consume the service. Preferably in Python, but the language is free. Necesito crear un script para consumir un servicio SOAP con WSSecurity para Encriptar y Firmar el XML, el ejemplo mas cercano que puedo dar es la forma en la que SOAPUI se configura para consumir el servicio. Preferiblemente que sea en python, pero el lenguaje es libre
Hi, I am a python programmer and I am trying to learn how to code with the OpenHoldem framework, but since I have very little knowledge of C++, I feel a bit overwhelmed by the huge documentation, for this reason I am searching for someone with experience with OpenHoldem, and who already knows how to play poker to be able to understand what I want my bot to do, and transcribe it in code. I already have a warbot profile so I do not need a full poker bot from scratch. Details: - the bot is going to play spin (3 players) on a poker skin already available in the warbot list - it needs to adapt based on the opponents (I will provide with a list of players against whom it has to change some choices in game) -it needs to...
...proficient developer who can add a page to my website that interfaces smoothly with my MySQL database. The website already has formatting etc, so I'm not looking for that. The database stores a variety of exercise data, and the webpage needs to display this data in an intuitive and user-friendly manner. Key webpage features include: - Display of exercise data: Each exercise's description and its difficulty level should be displayed. There's also a column in the database containing YouTube URL links, so another important feature the webpage needs is the ability to watch these exercise videos directly from the webpage. It is a simple database with only one table. - Users should be able to select the exercise they wa...
I'm looking for a programmer to help me build a visa appointment bot for personal use. Key Requirements: - This is a personal project, not for a business, and the primary goal is to automate the task of securing a visa appointment. The Bot: - The bot should be able to navigate a visa appointment booking system, select the appropriate options, and secure an appointment on my behalf. Skills and Experience: - Proficiency in bot programming and automation is crucial. - Experience with task automation and appointment booking is a plus. - Understanding of web scraping and navigation is a requirement. - Attention to detail is important to ensure the bot selects the correct options during the appointment booking process. Please get i...
I urgently require a web scraper proficient in extracting data from xing.de. I will provide a file of specific company names, for which I want to obtain the number of employees. Your task will involve: - Gathering accurate and up-to-date data on the number of employees for each company on the list - Formatting the information suitably for my usability. You need to have proven experience in web scraping, particularly on professional platforms such as Xing. Familiarity with German language platforms is beneficial. The deliverable is a neatly formatted file containing company names and their respective employee numbers.
I'm in need of a professional who can help me extract specific data on the results of the Tokyo 2021 Paralympic Games from the official website - The data I require includes: - Athlete profiles - All the results of ea...It should be in a similar format as this dataset on the results of the Olympic games: No specific analysis is needed on the extracted data. Ideal skills and experience for this job include: - Proficiency in web scraping - Experience in data extraction - Expertise in data formatting and CSV files Your professional approach and ability to deliver accurate, complete data will be crucial. Please bid if you're confident in your ability to handle this task.
I need a Python expert with an ability to cover various functionalities as per the need. The project might involve data analysis, web scraping, automation, or could be anything else as per the project requirements. The ideal candidate should have: - Expertise in Python programming and its different libraries. - Experience with data analysis, web scraping, automation. - Strong problem-solving skills. While applying, please share: - Your past work related to Python programming. - Your Python programming experience level. - Detailed proposal of how you can assist in this project.
We are seeking a skilled freelancer to automate the process of sending student data to school coordinators via WhatsApp. The task involves parsing a large Excel sheet containing student data, splitting it into smaller sheets based on schools, and sending each school's data to the corresponding coordinator's WhatsApp number. The main tasks include: Data Parsing: The freelancer will need to parse the provided Excel sheet containing student data. The data includes student names, grades, schools, coordinator names, coordinator WhatsApp numbers, and student codes. Data Splitting: The freelancer will develop a Python script to split the large Excel sheet into smaller sheets based on schools. Each smaller sheet should contain data for students...
...Stack Developer with experience in AI technologies, web development, and data processing to build an automated pipeline for creating AI images. The successful candidate will be responsible for developing a complete solution that includes trend analysis, automated prompt generation, integration with image generation APIs (such as DALL-E, Stable diffusion and MidJourney), backend infrastructure setup, and frontend design. Responsibilities: Trend Analysis: Implement a system to analyze and extract trends from Google searches stored in an Excel file. Prompt Generation: Develop an automated system to convert trend data into creative prompts suitable for image generation APIs. API Integration: Connect with external APIs like DALL-E or MidJourney to generate...
I am seeking an experienced developer to create a website scraper which is capable of collecting various pieces of data. This savvy tool must be designed to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints ...
I'm in immediate need of a Python Django developer. Even though the specific tasks were not outlined, experience in database management, user authentication, and API integration would be advantageous. Whether you have front-end development experience is not crucial, but it could be a plus. The purpose of the Django project has not been specified, but skills that cater to building a website, creating web applications, or backend development for an existing project could be beneficial. Please detail your previous experience, as it is the deciding factor for this job.
As a Python Developer with less than a year of experience, I've been actively involved in web development and data analysis. I have particularly worked with Django and Pandas frameworks. I'm now seeking new opportunities where I can further develop my skills, work with experienced professionals, and make meaningful contributions to projects, especially in the web development and data analysis space. Ideal candidates for this project should: - Have a good understanding of Python and its frameworks (Django, Pandas) - Be able to provide guidance and mentorship for a less experienced developer - Have previous experience in web development and data analysis - Be supportive and open to new ideas and approaches
...freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautif...
I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.
I'm looking for a diligent professional who can i...within a .csv file. The deliverable I expect from this project is a separate report containing the price of each product, along with additional details such as a link to the retailer's page and the price history. Key Responsibilities: - Extracting and updating the price information of electronic products from the Internet, based on the .csv file provided. - Incorporating a detailed report that includes the prices, a link to the retailer's page, and the price history of each product. Skills and Experience: - Proficiency in data extraction, research, and analysis. - Experience with web scraping tools. - Strong organizational skills to present the data in a clear, concise manner. - Prior ex...
I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.
I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.
I'm in need of an expert in Python, HTML and JavaScript programming. I am working on a project that involves developing a software tool. Key tasks involve: - Python programming - HTML development - JavaScript programming The main goal is to develop a high-functioning software tool. The ideal candidate should have expert level experience in all three programming languages. Your proven track record and portfolio of similar projects will help you stand out. This meticulously demanding job needs the best of the best. I am counting on your commitment to detail and your cutting-edge proficiency to produce a highly reliable software tool.
I'm in need of an experienced backend developer to create a mail parser with the following specifications: - **Email Protocol:** The mail parser should support SMTP, so proficiency in this area is a must. - **Primary Goal:** The primary function of this mail parser should be storing emails in a MySQL database. If you have experience with database integration, this would be a big plus. This project requires expertise in backend development, specifically with an understanding of how SMTP works. You should also be familiar with MySQL and have experience in integrating databases into applications. Please provide examples of similar projects you've worked on in your proposal. Thank you.
...for a skilled web scraper who can extract detailed information regarding the sellers on the Miravia website. Requirements: - Extracting Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping and data extra...
...store experience, a keen eye for detail, and proficiency in spreadsheet management. You'll be tasked with: - Keyword Optimization: Adjust the product titles on my Wix store to ensure they are optimized for search engines. Experience with SEO would be beneficial for this. - Database Creation: Develop a comprehensive database for all my products. This will include attributes like Product names, Product prices, and Product URLs. - Formatting: The database should contain separate columns for each product attribute. Strong organizational skills and experience with data entry would be ideal. Ultimately, the goal is to streamline the management of my product listings for a smoother business operation. Prior experience with Wix and creating product...
I'm looking for a seasoned Python developer with specific experience in image especially video analysis to create a script that can process a full mp4 video and identify the positions of noise in the video. The idea is to scan the video, locate identify the different type of noises and their value and externalize this findings into a json file Key Requirements: - The script (OOP based) should be able to read a video in mp4, mkv, mov format. - The library used for reading the video is not fixed. You can choose from libraries like (e.g. OpenCV, PyAV, or MoviePy, but the solution should be compatible with both Windows and Linux (and mac) - The output should have details of the signal, the different type noises, the common ratios and finally the values ... - ...
I need help with scraping specific information from urls (we will provide). The key details I need are the company name and contact information. Website Phone Email Brand Country Of Origin Total Entries: 1704 No research required, you just need to copy paste information from the fields onto a google sheet.
...project requires a meticulous approach to data preparation, which is critical for the success of our subsequent modeling efforts. The challenge lies in acquiring as much relevant data as possible for accurate predictions. Project Scope: 1. Preparation Stage: The freelancer will be responsible for identifying and researching all available sources of space debris data, both free and paid. This includes a comprehensive evaluation of data providers to ensure the data's relevance and quality. The output at this stage will be an Excel table summarizing the research, which will include provider names, links to data or registration, pricing (if it is a paid source), additional requirements from the provider, and descriptions of the data. We anticipate identifying up ...
...good understanding of Mechanical Engineering and Data Science to help me set up a database that records the live feed of on-board sensors in a car. Key Responsibilities: - Utilizing an On-Board Diagnostic Tool and an app to record the data - Implementing a database to store the collected sensor data - Analyzing the data primarily for predictive maintenance using statistical analysis Ideal Skills: - Mechanical Engineering background - Proficiency in working with On-Board Diagnostic Tools - Strong experience in statistical analysis - Knowledge of database management systems and data analysis tools - Experience in predictive maintenance is a plus This project requires attention to detail, analytical thinking, and the ability to tr...
I am searching fo...apply their knowledge towards data analysis, market research, and performance monitoring. Its a small assignment This assignment involves diving into a snowflake database to explore how customers behave. The goal is to find useful information that can help the Product team make decisions to make the business grow. After you uncover insights, you'll suggest changes to the product, like adding new features, making current features better, or even getting rid of features that aren't working well. You need to do the analysis, create graphs to show your findings, share all the code you used, and also come up with a plan for an A/B test to try out one of your suggested changes. Note: Its a short assignment, ...
...with the good quality profiles on the below shared requirement . Skills Required - Python , ReactJs and AWS ( For Technical Lead – Team lead experience required ) Experience – Lead – 9-+ years – 6-9 Years NP – Immediate – 10 Days Job Description As a Tech Lead, you will have key responsibility for the critical tech design and architecture decisions for your team. It is your responsibility to drive projects forward, mentor junior team members, ensure alignment with the company’s overall architectural direction, and contribute to continuous improvement initiatives. By delivering innovative and reliable software, you will contribute to the success of our organization and make a meaningful impact to thousands of...
I'm looking for an experienced server administrator to optimize my dedicated server running Almalinux 9.3 + Plesk. The server is currently performing poorly with slow website loading times and database slowdowns, which is unacceptable as I regularly have more than 500 concurrent visitors. The primary focus of this project will be optimizing the server's Plesk settings, Postgres and MariaDB databases, and PHP 8.2 configuration. Key tasks will include, but are not limited to: - Configuring Plesk for optimal performance, including adjusting server pool size - Identifying and implementing improvements to Postgres and MariaDB settings to reduce slowdowns - Tuning PHP 8.2 to enhance website speed and performance Ideal candidates for this p...
I am seeking an experienced Django and Python developer to assist with the development of a large-scale social media platform. This exciting project will be based on a reasonable monthly salary, with a requirement that your screen be shared during work hours for collaboration purposes. Your role will involve: Key Skills and Experience: - Expertise in Django and Python. - Prior experience with GraphQL. - Solid understanding of modern, minimalist user interfaces. - Experience in social media platform development would be advantageous. As for the user interface, I am leaning towards a minimalistic and modern design. This project promises to be challenging and rewarding, perfect for a motivated, and talented developer like you.
