• 7 root sites and in total 48 subsites.
• The script will be run on Windows Server 2016.
• As you know the RDP session will terminate therefor scipt will need to use a headless browser in the background sometimes.
• The script take a list of names and from this list it will generate direct links for 99%-100% of them (and crawl the remaining sites). There will be many different input files, the format always remains the same however, the data/names will be different.
• All of the data is in a table on the site
• All output formats and documentation are written
• Basic features such as enabling/disabling sites, custom crawl delay, pause, play, skip, on-screen status display, custom timeout limits /retry attempts are required.
• Proxies rotation functionality required.
• 1 site has a login.
• Should be optimized for efficient use of memory and CPU + Use API links when possible.
5 Root sites , 0 subsites.
Script will input the same input file onto the sites and use the sites "download to excel" feature.
I am the project manager and a Windows System/Networking Administrator with a high IT expertise and project high feedback with 5 years experience here. I'll provide a lot of testing and system resources such as a few Windows VPS'S. Contact me if you are serious about the project. Python is preferred but not required. Long term work/ more projects are available. Unfinished script available.
24 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön
Hi, is that an absolute requirement to run scripts on windows server? If you're only after data, I can run those on my side and provide you only with the data in a timely fashion. Just tell me what you want to scrape
Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.
I have been working in software development for 6+ years and I have done a countless number of scraping projects..Please provide more details over chat..
Expert in writing webscraping scripts. Available to start immediately and complete as soon as possible. Please contact in PM to discuss details if you are interested. Thank you.