Senior Apache Kafka Developer

Renaissance Infosystems โ€” Australia ยท Posted ~3 days ago

Senior Full-time

Skills

Apache Kafka architecture Kafka administration Kafka brokers Topics and partitions Replication and ISR Consumer groups Cluster management Kafka upgrades Capacity planning High availability Disaster recovery Kafka producers and consumers Kafka Streams ksqlDB Event-driven architecture Real-time data processing Performance tuning Troubleshooting Root cause analysis Microservices architecture Event sourcing CQRS Asynchronous messaging Kafka security CI/CD Docker Kubernetes Terraform Monitoring Apache Kafka Java Spring Boot Scala Python Prometheus Grafana Confluent Control Center ELK

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Summary

A technology organization is seeking a senior streaming-data engineer with deep expertise in Apache Kafka architecture, administration, and production operations. You will design and manage highly available clusters, build real-time event-processing systems, optimize throughput and latency, troubleshoot complex production issues, and integrate streaming infrastructure with enterprise applications, APIs, databases, cloud platforms, and microservices. Strong knowledge of Kafka security, DevOps automation, containers, infrastructure as code, and monitoring is expected.

Highlights

Senior-level opportunity focused on large-scale real-time data infrastructure, with deep ownership of Kafka architecture, performance, reliability, security, and production operations. The role spans modern streaming, microservices, cloud integration, automation, and observability.

Description

Senior Kafka Developer Role Description Apache Kafka Architecture & AdministrationDeep understanding of Kafka brokers, topics, partitions, replication, ISR, consumer groups, and cluster management.Experience with Kafka upgrades, capacity planning, high availability, and disaster recovery.Kafka Development & Stream ProcessingStrong hands-on experience developing producers and consumers using Java, Spring Boot, Scala, or Python.Expertise in Kafka Streams, ksqlDB, event-driven architecture, and real-time data processing patterns.Performance Tuning & TroubleshootingAbility to optimize throughput, latency, partition strategy, retention policies, batching, compression, and consumer lag.Skilled in root cause analysis, log analysis, and resolving production issues in large-scale Kafka environments.Integration & Microservices ArchitectureExperience integrating Kafka with enterprise applications, APIs, databases, cloud platforms, and middleware.Strong understanding of event sourcing, CQRS, asynchronous messaging, and microservices design patterns.DevOps, Security & MonitoringProficiency with Kafka security including SSL/TLS, SASL, ACLs, RBAC, and data governance.Experience with CI/CD pipelines, Docker, Kubernetes, Terraform, and monitoring tools such as Prometheus, Grafana, Confluent Control Center, and ELK. Regards, Reshu Seth Recruitment Consultant Renaissance InfoSystem M: +61 478 487 026 E: reshu@reninfo.com.au W: http://www.reninfo.com.au