Snr data engineer - 6 Months contract

The position requires an individual to lead the effort to design, build and configure applications, and act as the primary point of contact. Technical BA knowledge and experience will be considered as an important advantage. Job Description: • Provide data delivery pipeline based on Company’s Azure cloud environment. • Maintain data integrity, availability and confidentiality for multiple sources and users Tools: Azure Data Factory, Azure Data Lake Language: SQL, JSON Knowledge: Azure PaaS Data services (i.e. IoT hub, Data Factory Data Lake, Blob Storage, Network security and authentication on hybrid cloud environment, RBAC and ACL, Relational database) • Customize and deploy service instance on Company's DevOps Tools: Azure DevOps Pipeline, Ansible role, Azure Active Directory Language: Ansible, Jinja Knowledge: Infra as a code, CICD, Ansible Roles and Playbook, Azure Resource Management • Prepare, optimize and deploy data preparation process Tools: Azure Databricks, Azure Data Lake Language: Python, Spark, SQL Knowledge: Data tools and libraries (Pandas, Jupyeter, Sklearn, Keras, TensorFlow), Cluster environment, Data structure, Code optimization