Summary
✨ AI‑Generated
A lead cloud platform engineering role focused on building secure data platforms, automating infrastructure, and developing solutions in restricted enterprise environments.
Highlights
Lead-level cloud engineering opportunity focused on automation, data platforms, and complex enterprise environments.
Description
Lead Azure Databricks Platform Engineer
Hybrid – Toronto ON
Contract Role
Key Responsibilities
We are seeking a seasoned Principal Cloud Engineer [Individual Contributor] who thrives in restricted Azure setups – where native features are locked down, so you’ll code workarounds like custom microservices to replicate them.
Focus on automating Databrick workspace onboarding via IAM modules, using Terraform for IaC despite limitations, and build ingestion pipelines that bypass disabled tools with Python or similar.
Need proven coding chops to trigger those behaviors securely, plus banking or fintech experience handling compliance in tricky environments.
Strong Expertise in Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github), Obs (Dynatrace),
Nice to have : Java, Kafka , Casandra, Microservices, API, Flink, ZeroMQ, Protocol Buffers
Able to write the complex code and fix the issues
Should have strong problem solving capability
Collaborate with stakeholders to understand requirements and deliver robust solutions independently
Responsible for both development and strong expertise to debug and fix any post production issues for their developed code
Functional experience of Retail Banking, capital markets, securities processing will be advantage
Must have skills – findable only
Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github),
Must have skills that can be trained
Obs (Dynatrace)Nice to have skillsTerraformJava,Kafka ,Microservices,APIDistributed Storage System (like ADLS, S3, Google Storage)Airflow
