Software Engineer - ML Infrastructure

We're hiring on behalf of a Haystack partner! The Role • Lead the design and implementation of ML infrastructure platforms, including systems for capacity management, workload scheduling, and fleet orchestration across ML accelerators. • Develop machine learning tools to optimize and analyze ML workloads, from architecture through multiple delivery generations. • Collaborate with ML scientists, training infrastructure engineers, hardware teams, and internal customers to ensure seamless ML accelerator access. • Build high-impact solutions to deliver to a large customer base, focusing on efficiency, automation, and defect resolution. • Work in a startup-like development environment on critical projects with significant design ownership. What You'll Need • 3+ years of professional software development experience. • 2+ years of experience in designing or architecting new and existing systems, including design patterns, reliability, and scaling. • Experience leading machine learning tool projects, from architecture to delivery. • Deep knowledge of profiling, optimization, resource management, scheduling, and code generation. • Experience working on new instruction set architectures (CPU, NPU, GPU, etc.). • Proficiency in programming languages such as Go/Java, Python, and Javascript/Typescript. What's On Offer • Competitive annual salary ($143,700 - $194,400) plus potential for sign-on bonuses and stock units. • Opportunity to work on cutting-edge AI infrastructure at the intersection of Kubernetes, custom silicon, and large-scale ML workloads. • High-impact, high-visibility role that directly accelerates the output of numerous engineers. • Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave. Apply via Haystack today!