Summary
✨ AI‑Generated
A software engineering role focused on designing fault-tolerant distributed systems, scalable backend services, and infrastructure components for data-intensive applications.
Highlights
Opportunity to build large-scale backend systems powering AI workloads with strong focus on reliability, performance, and engineering ownership.
Description
Job Description
About the role
Build and evolve core distributed systems that form the foundation of an internal AI Platform Enable AI/ML teams by providing scalable, reliable, and high‑performance backend services Focus on platform and infrastructure components, not model developmentOperate in a domain where correctness, performance, and fault‑tolerance are criticalTake ownership of systems that move, process, and serve data at scale for AI workloads
Responsibilities
Architecting solutions: Taking a leading role in technical design discussions to create fault-tolerant, high-performance distributed systems from the ground up.Experience building distributed systems and the associated design patterns around sending data around.Prior work history with using either of the followingo Scala: Experience with frameworks like Akka / Pekko, Cats Effect
o Golang: Experience building concurrent services with channels and goroutines.
Implement fault-tolerant processing with clear delivery guarantees (at least/exactly-once), idempotency, backfill/reprocessing, and schema evolution.Leveraging cloud infrastructure: Building and optimizing services to run on modern cloud platforms such as AWS, GCP, or Azure, and leveraging containerization technologies like Docker and Kubernetes for deploymentDesign and implement robust event-driven microservices using Apache Kafka for real-time data streaming or batching systems to ensure high performance and fault tolerance.Collaborate with Data/ML and Platform teams to define data contracts, SLAs, and governance policies including cross-team architectural designs.
Educational Qualifications:
Bachelors in computer science, Software/Computer Engineering, or related field (master's preferred or equivalent industry experience).Strong CS fundamentals: algorithms, data structures, operating systems, networking, and distributed systems.
Industry Experience:
3–5 years building backend systems at scale, including data pipelines or streaming platforms in production.Proven track record delivering high-throughput, low-latency services with strong reliability and operability.Cross-functional collaboration with Data/ML, Analytics, and SRE/Platform teams.
Technical Skills:
Languages: Proficiency in any of these backend programming languages: Scala, Go, Rust, Java, PythonConcurrency Frameworks: Akka/Pekko streams, fs2, Java Streams, go-channels, TokioWeb Frameworks: Akka/Pekko http, Java Springboot, Scala Play,Streaming & Batch: Kafka, Spark;Storage & Formats: S3/GCS/Azure Blob, HDFS; Parquet/ORC; delta tables.Interchange formats: Avro/Protobuf/JSON Schema.SQL: Postgres or equivalent and be proficient in writing CTEs, joins, etc with fluency in analyzing data.Reliability & Observability: working with Prometheus/Grafana/Open Telemetry; alerting & dashboards.Cloud & Infra: Docker, Kubernetes
