Azure Databricks

Bullit Management Services Limited — Australia · Posted ~3 hours ago

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Description

Senior Azure Data Engineer / Lead – Key Skills8+ years of experience in Data Engineering / Software Development within Agile environments.Strong hands-on experience with Python and SQL; Java knowledge is an advantage.Proven experience in designing and developing complex data pipelines.Strong expertise in Apache PySpark, Azure Synapse, Azure Data Factory (ADF), Azure Functions, ETL pipelines, and data modelling.Hands-on experience with SQL and NoSQL databases, including MS SQL, along with Azure Data Lake Storage Gen2 (ADLS Gen2) and cloud-based object storage.Experience working with distributed processing systems and clusters for large-scale batch processing.Understanding of MLOps architecture and practices.Strong knowledge of modern data modelling, data warehousing, and large-scale data architecture.Familiarity with Azure DevOps and Git.Good understanding of ETL and data warehousing methodologies; Informatica experience is an added advantage.