Summary
✨ AI‑Generated
Join a data engineering team responsible for designing, building, and optimizing high-throughput data pipelines on a modern cloud analytics platform. You will work extensively with distributed processing, SQL, Python, and Scala-based Spark development while applying data engineering and data warehousing concepts. The role is hands-on and focused on scalable, reliable data solutions.
Highlights
Permanent data engineering role focused on designing, building, and optimizing high-throughput pipelines on Azure Databricks. The position offers hands-on work with modern big-data technologies and substantial responsibility for scalable data processing.
Description
Hiring for Data Engineer- Azure Databricks
About Us: Renaissance Info Systems is a technology and digital recruitment agency, connecting contract and permanent professionals with clients across Asia-Pacific.
We aim to differentiate ourselves through our level of responsiveness, and our understanding that comes from being an IT recruitment agency from the IT Industry.
Our recruiters balance sophisticated and simple inter-personal techniques to assure a strong candidate network.
Know More: http://www.reninfo.com.au
Role/Title: Data Engineer- Azure Databricks - 6-12 Years
Mode of Hiring: Permanent
Location: Sydney
Job Description:
Mandatory skills
1.
Azure Databricks
2.
Scala Spark
3.
SQL
4.
Python
Good to have skills
Databricks, SQL, Python, Data warehousing conceptsDetailed Job description (Role & Responsibility, Skill and Experience range)We are looking for a hands on Developer Programmer to design, build, and optimize high throughput data pipelines on Azure Databricks using Spark (Scala) and SQLDesign & develop scalable ETL/ELT pipelines in Azure Databricks using Spark (Scala) and SQL, following medallion architecture (Bronze/Silver/Gold) and Delta Lake best practices.Proven expertise in designing real time and near real time integrationsOperationalize workloads: jobs & workflows scheduling, CI/CD with Git (e.g., Azure DevOps), secrets management, and observability.Expertise in cloud platforms and related technologies, specifically:Hyperscalars Azure, AWSData Platforms ‿ (e.g.
Databricks) and big data technologies.Big Data Hive, Impala, Sqoop, Spark (Scala/ Python)Real time data processing frameworks Spark Streaming, Apache/Confluent KafkaCICD tools ‿ GitHub, Confluence, Jira, JenkinsProficiency in SQL, Python, and data integration tools.Familiarity with Master Data Management solutionsExcellent communication and stakeholder management skills.
Note: No Visa Sponsorship
Interested candidate please share your resume ASAP.
Thanks and Regards,
Nidhi Anand
Recruitment Consultant
Renaissance InfoSystem
C: 0423430032
E: nidhi@reninfo.com.au
W: http://www.reninfo.com.au
