Peruttu

Parsing Text to database, php / curl

I need the following completed right away to extract data which will be done in daily, weekly or monthly intervals. It needs to be entirely automated once I input the url for the web page into the mysql database.

There are basically three types of pages to extract data from.

A web page with no form.

A web page with a form to get the desired data.

A web page or pages that may require more than one form or may use AJAX or javascript to update menus used to fill the form.

The first project will be data extraction with no form on the page. After this first project the next project will use form filling as well. Requirements: Linux, php5 minimum and mysql5 minimum.

This script will be run as cron job. A db query will be done based upon the interval type like daily, weekly or monthly. After each url is fetched, cookies and cache/session must be deleted. (CURL??) I also need a separate script to pull table headers from page to help input field mapping when inputting url before the main script is run.

How it runs: on server with linux/php/mysql/curl

[url removed, login to view] Query - Fetch URL page & field mapping from query & parse text in tables to extract data according to field name mapping table and upload extracted data to database tables.

[url removed, login to view] tables with last run date for extraction.

[url removed, login to view] log entry for errors where data not extracted.

Total of two scripts. Need this immediately.

1. Script to pull table headers from page and enter into database.

2. Script to parse table data and upload to mysql database.

Variables will be used so that cron jobs will use the same script for different queries.

Taidot: PHP, SQL, Tietojen kaavinta verkosta

Näytä lisää: parse text database php, parsing text database, parsing text database php, php web page parsing, php curl database, database query curl, php parsing text extraction, javascript parse text field update database, parse curl data, php curl parsing web, parsing web pages curl, curl web page parse, where to get data entry job, types of jobs, types of data entry errors, types of ajax, sql get date, session php, php intervals, php create table, php ajax sql, parsing input, mapping jobs, input jobs, how to create php pages

About the Employer:
( 43 reviews ) portland, United States

Projektin tunnus: #494801

2 freelanceria on tarjonnut keskimäärin 500 $ tähän työhön

webmediaexperts

please see the pmb for more detail

500 $ USD 12 päivässä
(15 arvostelua)
4.8
valkyresoftware

They way I understand your requirements, I am only bidding on the first script which will pull the data from an plain html page with no forms or ajax. I know you will be pleased with my work (I have been programming Lisää

500 $ USD 14 päivässä
(0 arvostelua)
0.0