Santosh L.

Seasoned data engineer with expertise in setting up data pipelines, hadoop and ecosystem clusters, ETL jobs along with their administration and maintenance. Proficient in: Hadoop Ecosystem - have production experience with Cloudera, can work with others as well. I have managed and worked on Hadoop 2.7 along with Kafka, Storm and Spark. Couchbase Cluster - Worked and maintained a huge Couchbase 2.2 cluster. Scraping - Built a scalable scraping framework which is a part of big data pipeline. Misc APIs - APIs to ease the life of developers Centralized Monitoring Platform - One stop solution for monitoring variety of metrics. Full Stack Application - Built internal [backoffice] applications for multitude of purposes. Languages: Java, Python, Scala, Go, JavaScript Tools: Hadoop - HDFS, MapReduce, HDFS, Hive, Pig, Spark, Storm, HBase, Cloudera, Oozie, Sqoop Celery - for task distribution along with its customisations Kafka, Couchbase, Cassandra, HBase, OpenTSDB, Grafana, Spring