Summary
✨ AI‑Generated
A technical leadership position responsible for guiding developers and designing enterprise-scale data solutions. The role requires expertise in distributed processing, backend development, ETL pipelines, and engineering best practices.
Highlights
Leadership role guiding engineering teams while building scalable data solutions with modern processing technologies and delivery practices.
Description
Development Lead _Apache Spark
(3 to 4 days week) Toronto
Role Overview:
We are looking for a seasoned Development Lead to guide and mentor a high-performing engineering team.
The ideal candidate will have strong hands-on expertise in Java, Scala, Apache Spark, and ETL batch frameworks, with proven leadership skills to drive end-to-end delivery of scalable data solutions.
Key Responsibilities
Lead a team of developers and data engineers in designing and implementing enterprise-grade solutions.Architect and oversee development of ETL batch pipelines using Spark and related frameworks.Provide technical leadership in Java/Scala programming for backend services and data processing.Collaborate with product owners, architects, and stakeholders to define technical roadmaps.Ensure adherence to coding standards, best practices, and performance optimization.Conduct code reviews, mentor junior engineers, and foster a culture of continuous learning.Drive automation, CI/CD integration, and deployment strategies.Troubleshoot complex issues in distributed systems and ensure high availability.Align development efforts with business goals and timelines in an onsite leadership capacity.Required Skills & Experience
Strong programming expertise in Java and Scala.Hands-on experience with Apache Spark (batch processing, distributed computing).Deep knowledge of ETL batch frameworks (e.g., Informatica, Talend, Spark ETL, custom frameworks).Experience with data warehousing concepts and large-scale data pipelines.Familiarity with cloud platforms (AWS, Azure, GCP) and big data ecosystems (HDFS, Hive, Kafka).Strong leadership and communication skills to manage onsite teams and coordinate with offshore PODs.Proven track record of delivering complex projects in Agile/Scrum environments.Preferred Qualifications
Exposure to streaming frameworks (Spark Streaming, Flink, Kafka Streams).Experience with containerization and orchestration (Docker, Kubernetes).Knowledge of DevOps practices and CI/CD tools (Jenkins, GitLab CI, Azure DevOps).Prior experience as a technical lead or architect in data-intensive projects.
