Summary
✨ AI‑Generated
A senior streaming and integration engineer is sought to build event-driven services and custom connectivity using Java and Spring Boot. The role includes Kafka producers and consumers, Flink-based stream processing, schema validation, API gateways, retries, failure handling, and cloud messaging infrastructure.
Highlights
Lead advanced event-streaming and integration work using Kafka, Flink, Java, and Spring Boot. The role covers stream processing, schema management, API integration, reliable delivery patterns, and modern cloud-based messaging infrastructure.
Description
Skills, Responsibilities
Job Description (JD): Kafka Senior Developer
Must-have Skills:
· Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
Build and maintain Kafka producers / consumers, topic integration logic, and event-driven services on Confluent Cloud / NGIP.Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.Implement integration with Schema Registry, topic schemas, and message validation controls.· Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication.
· Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling.
Good-to-Have Skills:
· Confluent Certified Developer/Administrator
Experience with stream governance, RBAC, and tiered storageBackground in data engineering, ETL, or microservices architecture· Familiarity with traditional messaging systems and data warehouses
· Experience in Agile methodologies and DevOps practices
Responsibilities:
· Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable
· Build and maintain Kafka producers / consumers, topic integration logic, and event-driven services on Confluent Cloud / NGIP.
· Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.
· Implement integration with Schema Registry, topic schemas, and message validation controls.
· Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication
· Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling
· Perform unit / component testing for custom code, Flink jobs, and interface logic.
· Support SIT, pipeline testing, defect fixing, replay, and root-cause analysis during test execution
· Support E2E testing with downstream teams and resolve integration issues across connectors, transformations, APIs, and Kafka topics
· Work with GitLab CI/CD pipelines for build, deployment, regression automation, and release support
