Summary
An experienced data engineer is sought to design and build scalable analytics and data warehouse solutions on Azure. You will work across data lakes, distributed data integration, modern data architecture, ETL, and analytics, using technologies such as Databricks, Spark, Python or Scala, and SQL. Strong experience with Azure data services and large, multi-format datasets is essential.
Highlights
Work on large-scale data engineering and analytics solutions using a broad Azure ecosystem. The role offers technically challenging work across data platforms, integration, warehousing, automation, and modern data architecture.
Description
Required skills and experience
8-10 years of hands-on experience in data engineering space, with ability to translate working solution into implementable working package and/or built new solution using Azure platformhigh proficiency and experience in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF) and Azure Databricks, services related to Azure Analytics, Azure data lake storage Gen2, Azure SQL/Postgres, Azure analytics services and good understanding of Azure identity (SPN, SAMI, UAMI etc.)experience in designing large data distribution, integration with service-oriented architecture, data mesh, data Lake and data analytics solution using Azure data services with large and multi-format dataproficient coding experience using Spark (Python/Scala) and SQLhands on experience with one of scripting language: Linux / PowerShell.prior ETL development experience using industry tool e.g.
informatica/SSIS/Talend etc., good to have knowledge in Kafka streaming Azure Infrastructurea proven track of work experience in cloud (MS Azure platform preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, and test-driven developmentExposure to Docker, Githands on experience with pipeline orchestration tools like Apache Airflow, Autosys, Control-M – Preferred Apache Ariflowproficient at working with large and complex code bases using GitLab/Github, Fork/Pull Model and CI/CDknowledge of DevOps tools and technologies (like GitLab CI/CD pipeline creation, YAML, Terraform, ARM, Puppet), Azure function app, logic app is a plusworking experience in Agile methodologies (SCRUM, XP, Kanban).
Work within an agile SDLC environment to deliver high-quality data solutionsyou should hold a relevant bachelor’s degree or equivalent.
Excellent communication skills, with fluency in English for both presentations and technical writing
