Web scraping to postgresql työt

I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Spee...

El D...estándar. Formación y Capacitación: Capacitar a los usuarios finales y al personal técnico sobre cómo usar y administrar Odoo. Cualificaciones: Educación: Licenciatura en Informática, Ingeniería de Sistemas o campo relacionado. Experiencia: Mínimo de 5 años de experiencia en desarrollo con Odoo. Conocimientos Técnicos: Profundo conocimiento de Python y frameworks web (ej. Flask, Django). Experiencia con bases de datos PostgreSQL. Conocimiento de tecnologías front-end (HTML, CSS, JavaScript). Certificaciones (Deseable): Certificación en Odoo (por ejemplo, Odoo Certified Developer). Habilidades: Excelentes habilidades de comunicación y capacidad para trabajar en e...

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing b...Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you...

I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.

I am seeking a professional to develop a software that can efficiently extract and present the scripts used on a list of URLs provided. The software should be able to handle up to 1000 URLs at a time and run specifically on Windows. Key requirements include: - Extracting scripts: The software should be able to seamlessly access the provided URLs and list the scripts used on each page. - Bulk processing: The software should be capable of handling a significant amount of URLs, up to 1000 at once. - Windows compatibility: It is essential that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip...

I am seeking an expe...ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the releva...

I'm in need of someone with strong experience in PostgreSQL for some critical tasks. - The ideal candidate should be well-versed in PostgreSQL, with a background in both database administration and development. - You must be able to handle complex issues that may arise with the database and be capable of performance tuning when necessary. - I expect you to understand the nuances of PostgreSQL and be able to provide solutions to potential problems with the database. - Any experience with data migration, query optimization and database design will be a plus. Please make sure to include your past work and experience with PostgreSQL in your application. Your detailed project proposals are highly appreciated.

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsib...leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I value clear communication and timely deliv...

necesito persona que me ayude a hacer scripting en PHP- I need someone to help me do PHP scraping

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

We are in the middle of migrating Django to a new server. - Both servers run Ubuntu 20.04, postgres 12, python2.7 - The Django Project is already transferred over - Nginx has been configured - Postgresql has been setup Our struggle is to get the actual application up and running again. Your job will be to: - help to perform a clean export of the postgres database on old server - help to import the postgres database on the new server - ensure the Django application is coming back up smoothly The work will be done using shared tmate ssh sessions.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks...

...experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise. Please stat...

...me dummy offers just to make the initial Contact and then ask for more money. The Project: Develop the project in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicati...

...data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency in web ...

Payment will be paid according to each repo in MS Projects' Jira system The payment calculation will follow the actual time for each repo except the time to fix bugs.

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for fur...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or automation is a plus.

St...with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership. To decide who is our partner and to see your understanding, please provide a sample with at least 50 data entries within 2 ...

scrape data from darty site and export it into excel file.

I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these tasks and be able to work...

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm in need of a skilled freelancer who can perform daily scraping of job titles from Indeed. Ideal Skills and Experience: - Proficient in web scraping, particularly from Indeed - Able to automate the scraping process on a daily basis - Competent in delivering data in CSV format Data Update Frequency: - It's essential that the scraping is carried out daily Delivery Format: - The scraped data should be provided in a CSV file Looking forward to your proposals.

As a beginner with keen interest in Full stack Java Script developer, I am looking for a tutor with an impressive full stack development track record and hands on experience. Tutor must teach every facet from front end(HTML, CSS, JAVASCRIPT),...beginner with keen interest in Full stack Java Script developer, I am looking for a tutor with an impressive full stack development track record and hands on experience. Tutor must teach every facet from front end(HTML, CSS, JAVASCRIPT), back end(JavaScript), Git & Git hub,React.Js, Node.Js with , database(MongoDB/PostgreSql), API’s, web security, DevOps deployment, cloud services(Aws/Azure), Test and debugging and project management. On every check point tutor needs to give real world project experience by Building pr...

I'm seeking a skilled freelancer to assist in collecting email addresses for an upcoming email marketing campaign. The ideal candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your un...

...developer, proficient with , to manage two key aspects of a project. Key Responsibilities: - **Database Design and Implementation**: Your primary task will be to design and implement a database system. I prefer PostgreSQL, so experience with this DBMS is a must. - **API Development and Integration**: The project requires a complex API development and integration task. You should be comfortable dealing with multiple endpoints and third-party integrations. Ideal Candidate: - Proficient in Backend Node.js development with a focus on - Prior experience in designing and implementing PostgreSQL databases - Proven expertise in developing complex APIs with multiple endpoints and third-party integrations - Strong problem-solving skills and attention to de...

...skilled Senior Python Developer to assist with a project that involves a blend of web scraping and data analysis, with a focus on the following tasks: - Extracting data from multiple websites - Automating data extraction and parsing - Analyzing and visualizing scraped data The ideal candidate should have: - Proficiency in Python, with a strong understanding of AI and Machine Learning - Hands-on experience with web scraping, particularly working with diverse data sources - Ability to automate data extraction and processing efficiently - Adept at data analysis, with the ability to visualize and interpret data Although I haven't specified any particular tools or libraries, your familiarity with tools like BeautifulSoup, Scrapy and Sel...

In this project, I'm searching for an experienced Python Developer who exhibits strong proficiency in web scraping, artificial intelligence, and machine learning. Key Responsibilities: - Utilize your expertise in Python, specifically focusing on AI-related tasks. - Web scraping will also be a significant part of the project, though details on the targeted data type are yet to be defined. Ideal Skillset: - Extensive experience with Python - High proficiency with AI and machine learning algorithms - Proven record of successful web scraping projects Please include samples of relevant Python, AI, or web scraping projects you've completed as part of your bid. I look forward to collaborating on this project.

...able to analyze and compare prices for a substantial number of products across multiple listed stores. - Avoiding Captcha and ad blockers: The tool should be designed to function effectively while avoiding common barriers like Captcha or ad blockers. - User-friendly filters: The tool should offer a variety of filters to help users refine their search results. - Display results directly on product pages: The comparison results should be integrated and displayed on the corresponding product pages. Or through a widget function. Project Scope: - Estimated 3,000 to 8,000 pages: The tool should be scalable enough to handle a substantial number of pages, ensuring it can support the growth of our product database. Ideal skills and experience for this pr...

...can help me automate my web search for bid opportunities (RFPs) for my telecom company. Currently, I rely on searching manually, but this process is time-consuming and not as efficient as I'd like. Key Project Requirements: - You will be responsible for setting up an automated search that looks for RFPs related to "fiber optic" or other telecom-specific keywords, which are due every May 2024 or similar queries. - This automated search needs to run every 2-3 weeks, ensuring that I stay up-to-date with new bid opportunities and future due dates. - You should have a deep understanding of web scraping and automation to accomplish this task. Additional Information: - I would like to receive notifications about new b...

Necesito generar deshboard y gráficos en Power bi desde 4 bases de datos • 1 base de dato en postgresql corporativa en aws • 1 base de datos en sqlserver en un servidor local • Google Analytics • Zendesk Son aproximadamente 50 gráficos personalizados con los que necesitamos hacer algunos dashboard de gestión. Es importante dejar documentado el trabajo y respaldadas las consultas en sql. Indispensable: • Dominio de Power BI • Experiencia previa en la creación de paneles para ejecutivos • Capacidad para integrar datos de bases de datos Indicar los accesos requeridos y los requerimientos tecnológicos para desarrollar el proyecto

...dummy offers just to make the initial Contact and then ask for more money. The Project: Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpage (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpage, indicating what needs to be extracted/...

I'm se...tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages 1-1087 Freelancer must provide a sample file of 150 records to confirm the format and data accuracy before completing.

I'm in need of a Chrome extension that can autom...in need of a Chrome extension that can automate certain tasks within the browser. Here's what I'm looking for: (I have some 3-5 extensions I want, so if you give attractive bid and do good work, you can expect to get more chrome extension projects from me) - **Functionality:** The primary purpose of this extension would be to check specific elements on the pages the user visits. - **Elements to Check:** The extension should be able to read and process the text content and links on the page. Ideal candidates should have experience in: - Chrome extension development - Web scraping and automation - JavaScript and possibly other relevant technologies for extension development. Ple...

...am in need of an experienced Chrome extension developer to create some chrome extensions Key Tasks: - Develop a user-friendly Chrome extension - Implement data extraction techniques to collect and organize information from various web sources. The ability to filter and manage this data is crucial. - Set up the extension for browser automation tasks. It should be able to perform repetitive actions on a webpage without manual intervention. Communication: I prefer to manage communication with the selected freelancer through the messaging feature available on Freelancer.com. Ideal Candidate: The ideal candidate for this project should have a proven track record in developing Chrome extensions, particularly those involving web scrapi...

I'm in need of an expert developer who can take the lead on the development of CrewAI, a platform intended to boost productivity by implementing autonomous agents. These agents will be responsible for several important tasks, mainly focused on data analysis, process automation, and digital marketing. Key Responsibilities: - Develop and implement an autonomous agent platform with Libraries of tasks, agents, tools to be organized by a user into Crews. - Ensure the agents are capable of accessing and interpreting data from a variety of sources, including databases, APIs, and websites. - Create a user-friendly Panel front end for the CrewAI platform that presents the user insights and controls of Crews in a clear and intuitive manner. Ideal Skills and Experience: - Proven ...

I am currently in need of a professional who can assist in completing a database for over +14000 companies. The goal of this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through data...

I need assistance with scraping data from a website and delivering it in an Excel file. The specifics of the project are as follows: I am looking for a person who will conduct scraping sessions for our business on a regular basis. Desired skills are knowledge of screen-scraper software, sql, Someone with Python knowledge will be better. Willing to follow instructions. Not cramped up with other jobs or other side hustles. Need to have solid internet connection. Expected work takes 5-10 hours per week, once fully trained. Must be responsible. Able to accept PayPal. - The source of the data is a website. This means the freelancer needs to have experience in web scraping. - The data should be delivered in an Excel file. Proficiency i...

I'm in a urgent need of Ruby Expert for the study project. I have a devloped code and it is running on heriku. The technology used are as below:- Ruby (Backend language) Ruby on Rails (Framework) Bootstrap (frontend library) Html + scss ( Front end) Jquery + JavaScript Database : Postgresql Due is tonight so if you are available now it will be helpful. Thank you. This is a time-sensitive project, so please only apply if you can dedicate the necessary time and expertise.

I'm looking for a freelancer to help me with email scraping to build a targeted email list in the education sector. Specifically, I'm interested in parents who are seeking tuition services for their children. Key Responsibilities: - Conducting research online to identify and extract email addresses of parents seeking tuition services for their children - Organizing the list in an easily accessible format that I can utilize for email marketing campaigns Skills and Experience: - Proficiency in email scraping and list-building - Prior experience in targeting the education sector is desirable - Understanding of lead generation and email marketing best practices

...addresses from both Facebook and Instagram. - Selection of the profiles for scraping should be primarily based on the following criteria: levels of user engagement and followers count. - Along with the email addresses, extract additional user information namely: the account name and its location. Ideal Candidate Profile: - Must have experience in deducing complex social media algorithms. - Understanding of digital privacy laws to ensure compliance during the extraction process. - Fluency in software that can automate this extraction process would be advantageous. My ultimate goal is to utilize this function to better target digital marketing campaigns, increasing its reach and effectiveness. I look forward to discussing the project details w...

I'm seeking an expert in web scraping to specifically help extract data (price, stock availability, description, review content,..) from e-commerce platforms. Your specific task will entail: - Identifying and implementing the most efficient and effective way to scrape data. - extracting all data related to a product (picture, price, description, reviews, rating,...). Your method should maintain adherence to all legal and ethical guidelines - I'll need details on this as your bid. This project will require: - Proficiency in web scraping tools and techniques. - Sound knowledge of data extraction and storing processes. - Ability to work with undisclosed e-commerce platforms. - Familiarity with review structures on e-c...

I'm in need of a skilled professional who can scrape data from Google. The project requires the extraction of names and email addresses for specific profiles to be used as a potential leads database. Upon successful extraction, the data needs to be presented in an Excel spreadsheet, CSV, etc. Ideal Skills and Experience: - Proven experience in data extraction from websites - Proficiency in Excel - Strong attention to detail and accuracy - Experience in extracting usernames and emails is a plus Deliverables: - The extracted Data - The data must be clean, organized, and formatted in an Excel spreadsheet I look forward to receiving your proposals!

I am looking to develop a web-based job extractor that's capable of aggregating job listing from various platforms across multiple countries with the following features: # Source Selection : The ability to select multiple sources for job scraping, including Google jobs. # Comprehensive Job Details: Extraction of all details included in the job listing, such as job title, company name, location, job description, requirements, etc. # Web Interface: A user-friendly web interface where users can enter the URL of the job listings page and initiate the scraping process. # Downloadable in .csv Format: The scraped job data should be downloadable in .csv format for easy analysis and storage. # Filtering Options: Ability to filter jo...

I am looking for an expert in web scraping who can efficiently extract business leads. While the primary purpose of the project was not specified, it is undeniable that these leads will play a pivotal role in marketing efforts, like sales lead generation, market research, and contact information collection. Although I did not mention a specific source site, note that the target is business owners, and their revenue and contact information. Therefore, having experience in scraping from professional networking and business directory websites such as LinkedIn or Yellow Pages would be welcomed. Lastly, the exact number of leads that I need hasn't been defined, so I am open to both small and large-scale operations. Ultimately, their quality is of more importa...

I'm currently using a Python scraping bot for my project, but I need to make some adjustments. Key Requirements: - The primary modification involves segmenting the scraped data by day. To achieve this, I would like to have a timestamp column added that differentiates data on a daily basis. This will allow me to have a better understanding of the data collected each day. Your Proposal: In your application, please provide a detailed project proposal. I'm interested in freelancers who can clearly articulate how they will approach this task and ensure its successful implementation. Ideal Skills and Experience: - Proven experience in Python scraping bot modification - Familiarity with data segmentation and timestamping