Auki

Kafka, Dibizium, postgreSQL, Scrapy, Scrapy-Cluster, Kubernetes, Docker, Proxies Consultation

We are looking to get answers on some questions involving Software Architecture requiring integration of Kafka, Dibizium, postgreSQL, Scrapy, Scrapy-Cluster, Kubernetes & Docker & various web proxies or proxy services and other log-aggregation softwares with kafka.

You must be someone who has used all these tools and has done some large scale scraping using scrapy, scrapyd/scrapy-cluster, collected log data from multiple vps & fed both types (scraped & log data) data to postgresql via kafka/dibizium. And various required dashboards for monitoring & analysis.

We would require about an hour on chat and if required 15 minutes on phone. Chat will be in two stages, at different times on alternate days. You must be expert in the subject.

Taidot: tiedonlouhinta, PostgreSQL, Python, Scrapy, Järjestelmänvalvoja

Näytä lisää: proxies myspace, hide away proxies, restore data folder postgresql windows, scrapy redis distributed, frontera vs scrapy cluster, scrapy cluster quick start, web scraping kafka, run scrapy in docker, scaling scrapy, scrapy kubernetes, scrapy docker compose, private proxies, unblockable proxies, daily proxies, nutch build cluster, want proxies, private socks proxies, consultation company, pentaho cube designer postgresql, canada free socks proxies 100 uptime

Tietoa työnantajasta:
( 4 arvostelua ) Amritsar, India

Projektin tunnus: #18804823