Summary
✨ AI‑Generated
A highly experienced backend engineer is sought to design and optimize secure, resilient event-driven architectures. The role centers on the Kafka ecosystem, including brokers, streams, producers, consumers, and connectors, while integrating cloud-native AWS microservices and modern AI capabilities. You will help establish streaming best practices and build reliable real-time data pipelines for a large financial organization.
Highlights
Build high-throughput and resilient event-driven architectures, work with cloud-native microservices, optimize distributed streaming infrastructure, and contribute to modern real-time financial data platforms.
Description
Position Overview
Kafka Developer
As a Kafka Developer at one of Canada’s Top 5 Banks, you will design, develop, and optimize high-throughput, resilient, and secure event-driven architectures.
You will play a pivotal role in modernizing our banking platforms by integrating Confluent Kafka with cutting-edge AI technologies and cloud-native AWS microservices.
We are looking for a powerhouse developer with deep expertise in the Kafka ecosystem (Brokers, KStreams, Connectors) who can champion best practices in event streaming and help shape the future of our real-time financial data pipelines.
Core Responsibilities
Kafka Ecosystem Development: Design, develop, and maintain robust Kafka producers, consumers, KStream applications, and custom Kafka Connectors.Broker & Platform Optimization: Demonstrate a deep understanding of the Confluent Platform to configure, optimize, and troubleshoot Kafka brokers, topics, partitions, and replication factors for high availability.AI & Data Pipeline Integration: Collaborate with AI/ML teams to integrate real-time event streaming with predictive models and intelligent automated workflows.Cloud Architecture & Microservices: Build and deploy scalable microservices using AWS services (Lambda, ECS, ECR, EC2) and connect them seamlessly via RESTful APIs.Troubleshooting & Performance Tuning: Act as a subject matter expert to diagnose complex distributed systems issues, tune performance, and resolve streaming bottlenecks.Leadership & Collaboration: Provide technical leadership, conduct code reviews, and effectively communicate complex architectural patterns to both technical and non-technical stakeholders.
Required Skills & Qualifications
Technical Skills:
The Core: Deep working knowledge and production experience with the Confluent Platform and standard Kafka components (KStreams, Kafka Connect, Brokers).Development: Strong experience writing optimized Kafka Producers and Consumers.Languages: High proficiency in Java, Python, or Node.js (Java preferred for heavy KStreams work).AWS Cloud Ecosystem: Solid hands-on experience with AWS Lambda, ECS, ECR, and EC2.Architecture: Mastery of Microservices architecture and building/consuming secure RESTful APIs.AI Exposure: Working experience or strong conceptual skills linking event-driven architecture with AI/ML workflows.Soft Skills & Leadership:
Problem-Solving: Exceptional troubleshooting diagnostic skills for complex, distributed environments.Communication: Excellent verbal and written communication skills—essential for navigating a matrixed banking environment.Leadership: Proven ability to take ownership of features, mentor junior developers, and drive technical decisions.Prior experience working within a Canadian Financial Institution (FI) or heavily regulated environment.Confluent Certified Developer or AWS Certified Developer certifications.
