DontApply.Club
Login Register

Senior Databricks Engineer

Carecone — Australia · Posted ~2 hours ago

Senior Full-time

Skills

Databricks Data engineering Data pipelines Data ingestion Data transformation Data orchestration Python SQL Data quality REST APIs API security Application development Lakeflow Connect Lakeflow Pipelines

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A Senior Data Engineer is sought to design and maintain scalable data pipelines and processing frameworks using a modern data platform. The role also includes developing web applications, integrating REST APIs, implementing secure authentication, and supporting testing, deployment, governance, and reliability.

Highlights

Permanent senior role combining data engineering and software engineering, with opportunities to build scalable pipelines, modern applications, secure APIs, and reliable data platforms.

Description

Role : Senior Databricks Engineer Type of role - Permanent Position Location : Sydney, Australia Job Description : Key Responsibilities Data Engineering Design, build, and maintain data pipelines using the Databricks native platform. Develop and support data ingestion, transformation, and orchestration frameworks. Build and manage solutions leveraging Lakeflow Connect and Lakeflow Pipelines. Develop scalable data processing solutions using Python and SQL. Ensure data quality, reliability, and performance across batch and near real-time workloads. Collaborate with architecture and platform teams to implement data governance and best practices. Software Engineering Design and develop modern web-based applications integrated with Databricks platforms. Build and consume REST APIs to support application and platform integrations. Implement secure API authentication and authorization mechanisms. Participate in application design, development, testing, deployment, and support activities. Contribute to CI/CD pipelines and promote DevOps best practices across projects. Platform & Integration Support enterprise integration requirements across multiple systems and platforms. Develop scalable, maintainable solutions aligned with enterprise architecture standards. Work closely with business stakeholders to understand requirements and translate them into technical solutions. Troubleshoot and resolve complex technical issues while ensuring high system availability and performance. Required Skills & Experience Essential 4+ years of experience in Data Engineering and Software Engineering. Hands-on experience with the Databricks Native Platform. Strong experience with: Lakeflow Connect Lakeflow Pipelines Data ingestion, transformation, and orchestration frameworks Proficiency in Python and SQL. Solid understanding of modern web application architecture. Experience with REST API design, development, and integration. Strong knowledge of API security and authentication concepts. Experience working across the Software Development Lifecycle (SDLC). Familiarity with CI/CD practices and DevOps methodologies. Strong analytical, troubleshooting, and problem-solving skills. Interested candidate can share share their resume at rahul.singh@carecone.com.au or call me on +61 283195529