Senior Azure Data Engineer

Techdoquest — Canada · Posted ~4 hours ago

Senior Full-time

Skills

Data engineering Azure ETL/ELT SQL Python PySpark Azure Data Factory Databricks Azure Data Lake Synapse DataOps CI/CD Microsoft Fabric Power BI Azure DevOps

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Design and optimize scalable cloud data pipelines and solutions for analytics and reporting. Work with Python, PySpark, SQL, modern cloud data services, distributed processing, DataOps, and CI/CD while improving data quality, reliability, monitoring, and performance.

Highlights

Senior data engineering role focused on scalable cloud pipelines, data quality, performance, modern Azure services, DataOps, and trusted datasets for analytics.

Description

Job Title: Senior Azure Data Engineer Experience: 6+ years We are looking for a Senior Azure Data Engineer to design, develop, and optimize scalable data pipelines and cloud data solutions. The role focuses on data engineering, integration, and preparing reliable datasets for analytics and reporting. Key Responsibilities Design and maintain scalable ETL/ELT pipelines for batch and real-time data integration.Develop optimized SQL queries, data models, and curated datasets for analytics.Build data processing solutions using Python, PySpark, and distributed processing frameworks.Implement solutions using Azure Data Factory, Databricks, Azure Data Lake, and Synapse or Microsoft Fabric.Improve pipeline performance, reliability, data quality, and monitoring.Implement DataOps practices and CI/CD pipelines using Azure DevOps.Collaborate with analytics teams to provide trusted datasets for Power BI and other BI platforms.Required Skills 6+ years of experience in data engineering, including hands-on cloud data platform experience.Expert-level SQL and strong data modeling skills.Strong proficiency in Python and PySpark.Proven experience building and optimizing large-scale ETL/ELT pipelines.Hands-on experience with Azure Data Factory, Databricks, and Azure Data Lake.Experience with Azure Synapse Analytics or Microsoft Fabric.Strong understanding of Apache Spark, distributed processing, and streaming technologies such as Kafka or Azure Event Hubs.Experience with Git, Azure DevOps, CI/CD, and DataOps practices.Understanding of Power BI data integration requirements, including preparing reporting-ready datasets. Dashboard development is outside the scope of this role.Nice to Have Experience integrating data with Domo.Exposure to Delta Lake, lakehouse architecture, and data governance.