Senior Software Engineer - Apache Kafka Infrastructure

Bloomberg — United States · Posted ~3 days ago

Senior Full-time Onsite USD 160000-240000 annually + benefits + bonus

Skills

Java C++ Python Go Scala distributed systems data structures algorithms system design low-latency systems high-volume systems high-availability systems unit testing integration testing Agile Apache Kafka Docker Kubernetes Node.js OpenStack JavaScript Jenkins Linux

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary

A senior software engineer is sought to build and evolve large-scale streaming and distributed infrastructure used by engineering teams worldwide. You will develop broker and client-side capabilities, contribute to ecosystem frameworks and open-source projects, build end-to-end user experiences, and design solutions for low-latency, high-volume, highly available environments. The role requires 4+ years of production programming experience in Java, C++, Python, Go, Scala, or similar; strong knowledge of distributed systems, data structures, algorithms, and system design; and a commitment to meaningful unit and integration testing. Experience with container orchestration, open source, networking, and Linux performance is highly valued.

Highlights

Work on large-scale distributed infrastructure that impacts thousands of engineers and applications worldwide. The role offers deep exposure to open-source technologies, opportunities to contribute upstream, end-to-end product development, system design at scale, direct collaboration with engineering stakeholders, and a strong culture of technical innovation and inclusion.

Description

Location New York Business Area Engineering and CTO Ref # 10051649 Description & Requirements The Bloomberg Managed Services organization (BMS) is responsible for creating and curating Bloomberg Engineering's "as a Service" software catalog and infrastructure. We develop and integrate products into a simple, elegant user interface and provide a concise way for engineers to create data-store and middleware instances. The BMS Streaming team focuses on providing streaming solutions on the BMS Platform powered by Apache Kafka and its ecosystem. Apache Kafka has quickly become the backbone of event driven architecture at Bloomberg and the main data bus for data distribution, live streaming, and general purpose messaging. Given that the majority of Engineering teams in the company already leverage our product in production, you’ll have the chance to positively impact virtually any product under the Bloomberg umbrella by joining our team. About The easiest way to learn more about what our team does and some of the challenges we face is to check out our talk at Kafka Summit: We are extremely proud of our open and inclusive culture, and value diversity of thought and perspective in every form. We're looking for engineers with a real passion for writing reusable, efficient solutions to complex problems, who can collaborate and work effectively on small teams to develop software that impacts thousands of power users around the world. We Work With Open-source frameworks and tools (Apache Kafka, Docker, Kubernetes, Node.js, OpenStack, etc)Java, Scala, C++, Python, Javascript, and Go as required to provide these frameworks in an easy to use manner for developersAll projects follow the team's SDLC practices, including Docker-based unit testing, Jenkins integration, API documentation standards, etc. We'll Trust You To Collaborate within an Agile, multi-disciplinary teamDevelop code around the Apache Kafka broker, its client libraries (C/C++, Java, Python), its ecosystem frameworks (Kafka Connect, Kafka Streams, Cruise Control, Burrow, etc.)Work on Open Source projects within the Kafka ecosystem and contribute changes upstreamDevelop an end-to-end full-stack user experiencePick up on new frameworks, experiment, and build software that works seamlessly on various environmentsAnticipate engineering needs and expectations from Bloomberg engineers, and build solutions that work for themCollaborate directly with product owners and application teams to understand requirements, conduct feature demos, and provide system design consultationsIdentify feature gaps in the technologies and work with the open source community and our vendors to co-design and co-develop features and bug fixes You'll Need To Have 4+ years experience programming in Java, C++, Python, Go, Scala or similar in a production environmentA Degree in Computer Science, Engineering or similar field of study or equivalent work experienceStrong communication and collaboration skillsStrong understanding of distributed systems, data structures, algorithms and system designExperience designing and implementing low-latency, high-volume, and high-availability distributed systemsCommitment to writing meaningful unit tests and integration tests We'd Love To See Passion for distributed systems and large scale data systems Familiarity with Apache KafkaFamiliarity with Kubernetes and DockerJava programming experienceExperience maintaining and contributing to large Open Source projectsExperience evolving and monitoring systems at scaleDeep understanding of TCP/IP and Unix networking, Linux kernel performance Salary Range = 160,000 - 240,000 USD Annual + Benefits + Bonus The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level. We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns. Discover what makes Bloomberg unique - watch our for an inside look at our culture, values, and the people behind our success.