Summary
✨ AI‑Generated
Join an advanced engineering team building scalable backend services for large volumes of concurrent AI-driven interactions. You will own challenging real-time systems, improve latency and throughput, strengthen reliability and observability, and shape maintainable architectures using modern Python technologies and LLM integrations.
Highlights
High-impact staff-level role focused on scalable real-time backend systems, AI-driven applications, production reliability, performance, and technical architecture.
Description
Staff Software Engineer – Berlin
We are partnering with our client, a cutting-edge software company in Berlin, to hire a Staff Software Engineer for a team at the forefront of Agentic Engineering.
You will play a pivotal role in building backend services that drive thousands of realistic, concurrent, AI-driven conversations at enterprise scale, directly impacting latency, throughput, reliability, and operational visibility in production.
Key Skills and Experience
High-performance, real-time systems: Designing and operating low-latency services for WebSocket/Socket.IO, server-sent events, and long-lived connections, including handling reconnects, backpressure, and partial delivery.Python (asyncio) expertise: Deep proficiency with Python 3.13, asyncio, FastAPI, Pydantic, and hexagonal architectures to build scalable, maintainable, and testable backend services.LLM integration: Experience integrating LLMs via SDKs and gateways, managing prompt-driven personas, streaming completions, and balancing cost–latency trade-offs in production.Concurrent, event-driven systems: Task orchestration and scheduling with tools like APScheduler, managing thousands of concurrent jobs, implementing retries, resilience, idempotency, and graceful shutdown.Data and storage: Working with MongoDB (async), Azure Blob Storage, and contract-first API design using OpenAPI/AsyncAPI.Observability and quality: Implementing OpenTelemetry, Datadog, structured logging, SLOs, and robust testing with pytest, Testcontainers, Pact, Locust, ruff, mypy, and SonarQube.Cloud-native delivery: Operating Dockerized services on Kubernetes with Helm, GitHub Actions CI/CD, feature flags, and Renovate.Leadership and ownership: Leading complex multi-month roadmaps, owning end-to-end delivery and operations, and thriving in fast-paced, product-focused environments.
If this aligns with your background and aspirations, we would be delighted to introduce you to our client's team.
