DontApply.Club
Login Register

Software Engineer - ML Infrastructure

Wearehaystack — United States · Posted ~2 hours ago

Mid

Skills

software development ML infrastructure system architecture design patterns reliability scalability machine learning tools workload scheduling capacity management fleet orchestration machine learning distributed systems

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A software engineering opportunity focused on building infrastructure platforms for machine learning workloads and accelerator fleets. You will design systems for capacity management, scheduling, orchestration, automation, and reliability, while developing tools that optimize ML workloads. The role offers significant design ownership and cross-functional collaboration. At least three years of professional software development experience and two years of system design or architecture experience are required.

Highlights

High-impact engineering role focused on large-scale machine learning infrastructure, automation, efficiency, and system reliability. Provides substantial design ownership and collaboration with specialists across machine learning, infrastructure, hardware, and internal engineering teams.

Description

We're hiring on behalf of a Haystack partner! The Role • Lead the design and implementation of ML infrastructure platforms, including systems for capacity management, workload scheduling, and fleet orchestration across ML accelerators. • Develop machine learning tools to optimize and analyze ML workloads, from architecture through multiple delivery generations. • Collaborate with ML scientists, training infrastructure engineers, hardware teams, and internal customers to ensure seamless ML accelerator access. • Build high-impact solutions to deliver to a large customer base, focusing on efficiency, automation, and defect resolution. • Work in a startup-like development environment on critical projects with significant design ownership. What You'll Need • 3+ years of professional software development experience. • 2+ years of experience in designing or architecting new and existing systems, including design patterns, reliability, and scaling. • Experience leading machine learning tool projects, from architecture to delivery. • Deep knowledge of profiling, optimization, resource management, scheduling, and code generation. • Experience working on new instruction set architectures (CPU, NPU, GPU, etc.). • Proficiency in programming languages such as Go/Java, Python, and Javascript/Typescript. What's On Offer • Competitive annual salary ($143,700 - $194,400) plus potential for sign-on bonuses and stock units. • Opportunity to work on cutting-edge AI infrastructure at the intersection of Kubernetes, custom silicon, and large-scale ML workloads. • High-impact, high-visibility role that directly accelerates the output of numerous engineers. • Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave. Apply via Haystack today!