I am looking for a Java developer.
This project is for creating a simple scraping tool by Java.
It also requires to run the program and gathering the data actually.
1) A command line tool creation by Java.
2) source code to me.
3) the program will check a directory site.
4) check the links up to some specified depth. may be 3 or 4.
5) traverse the pages and find some area. I guess 1000 pages or so.
6) parse the area and grab the data.
7) the data includes a linked file.
8) the program have to download the linked file too.
9) the area will include the information about the file.
10) the program will gather the information including the file size of downloaded file.
11) save the information into mysql with datetime.
12) after all the pages are parsed the program will exit.
13) running the app and gathering the data is also included with this project.
Lower bid will be appreciated for this project and customizing existing code can be acceptable.
This project is basically by Java but other languages may be acceptable according to your bid.