Summary
✨ AI‑Generated
A senior DevOps opportunity for an experienced engineer specializing in event streaming and cloud-native infrastructure. You will design and operate highly available Kafka environments, manage Kubernetes-based deployments, implement secure connectivity and access controls, and automate infrastructure through Terraform, Helm, GitOps, and CI/CD. Strong cloud experience and hands-on troubleshooting skills are essential.
Highlights
Work on large-scale event streaming and cloud-native infrastructure, with deep ownership of Kafka platforms, Kubernetes operations, security, automation, reliability, and performance.
Description
We are looking for a senior engineer with 10+ years of experience in event streaming, Kafka platform engineering, Kubernetes, and cloud-native infrastructure.
• The candidate should have strong hands-on expertise in Apache Kafka, Confluent Platform, and Confluent Cloud, including cluster design, topic management, Schema Registry, Kafka Connect, RBAC, ACLs, quotas, security, monitoring, troubleshooting, and performance tuning.
• The role requires experience deploying and operating Confluent Platform on Kubernetes using Confluent for Kubernetes, Helm, Terraform, GitOps, and CI/CD automation.
• Experience with Ansible-based Confluent Platform installation, upgrade automation, and configuration management will be highly valuable.
• The candidate should have practical knowledge of Kafka security setup, including SASL_SSL, mTLS, certificates, secrets, service accounts, identity pools, API keys, RBAC, ACLs, and secure connectivity patterns.
• Cloud knowledge across Azure, AWS, or GCP is expected, especially around networking, private endpoints, DNS, firewall rules, IAM, key vaults/secrets, storage, and secure access.
Experience with Terraform for Confluent Cloud provisioning, including environments, clusters, topics, service accounts, API keys, identity pools, RBAC/ACLs, networking, and access automation, is desirable.
• Knowledge of Spring Boot or Python for Kafka producer/consumer development, admin automation, validation scripts, and operational tooling is an added advantage.
• Experience with Flink, Kafka Streams, CDC, stream processing patterns, and real-time data pipelines will be a strong plus.
• Confluent Certified Developer for Apache Kafka and Confluent Certified Administrator certifications will be considered added advantages.
• The candidate should be capable of working independently, guiding engineering teams, and implementing secure, scalable, resilient Kafka platforms across nonprod and prod environments.
Responsibilities include:
• Kafka platform setup, environment standardization, cluster upgrades, certificate renewal, ZooKeeper to KRaft migration planning/execution, disaster recovery support, capacity planning, incident resolution, and production readiness reviews.
• The candidate should be able to design monitoring and alerting using tools such as Prometheus, Grafana, JMX exporter, OpenTelemetry, Confluent Metrics API, Datadog, Splunk, or similar platforms.
