HPC Infrastructure Site Reliability Engineer

Radiant Co — United Kingdom · Posted ~3 hours ago

Senior Full-time

Skills

SRE distributed systems HPC AI infrastructure Linux infrastructure incident management GPU infrastructure Linux

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A senior SRE position responsible for operating high-performance computing environments, improving reliability, and supporting large-scale distributed infrastructure.

Highlights

Work with large-scale compute infrastructure and advanced AI workloads in a mission-critical reliability environment.

Description

About Us We’re a fast-growing GPU-as-a-Service provider, delivering scalable, high-performance compute infrastructure purpose-built for AI and HPC workloads. Operating across global data centres, we run mission-critical environments where uptime, throughput, and ultra-low latency are non-negotiable. Role Overview We are looking for a senior Infrastructure Site Reliability Engineer with deep experience operating large-scale distributed systems and recent hands-on expertise in high-performance computing (HPC) and AI infrastructure. This is an operations-first SRE role, working in a 24/7/365 on-call environment, responsible for ensuring reliability, performance, and continuous improvement of mission-critical infrastructure. This role sits within a cross-functional organisation spanning network engineering, infrastructure SRE, Platform SRE, infrastructure tooling engineers (software) and data centre operations. The ideal candidate has progressed through large-scale, globally distributed or multi-site infrastructure environments and has more recently specialised in GPU-accelerated HPC systems. This role provides exposure to the latest high-density AI compute platforms, including next-generation GPU infrastructure at significant scale. You will bring strong breadth across bare metal, networking, storage, virtualisation, and orchestration, alongside deep HPC experience including NVIDIA GPU ecosystems, RDMA networking (RoCE and InfiniBand), and performance validation and benchmarking. Strong Linux and distributed systems expertise is essential. Alongside operational ownership, this is a deeply technical Infrastructure SRE role centred on advanced operational troubleshooting and performance evaluation across large-scale HPC systems. You will investigate complex, cross-layer issues spanning GPU compute, networking, storage, and orchestration, building a clear understanding of system behaviour under real production AI and HPC workloads. A key responsibility is performance evaluation, testing, and operational acceptance of new HPC environments, ensuring platforms meet defined reliability, scalability, and performance expectations before entering production. You will work across hardware, network, and software layers to validate readiness of high-density GPU infrastructure and support safe, predictable deployment at scale. You will also play a central role in continuous service improvement (CSI)—reducing operational toil, increasing automation, and improving reliability, consistency, and operational efficiency across the platform. This includes strengthening observability, refining operational workflows, and eliminating repetitive or failure-prone processes. Over time, you will help shape future infrastructure design and deployment approaches, feeding operational insight back into infrastructure engineering decisions and ensuring production learnings directly influence next-generation HPC platform evolution. What’s In It For You Join a team operating some of the world’s most advanced high-performance computing infrastructure. As a HPC Infrastructure SRE, you’ll work hands-on with cutting-edge GPU and CPU platforms — including the latest NVIDIA architectures — powering dense, large-scale compute environments used for AI, machine learning, and next-generation workloads. This is an opportunity to build expertise at the forefront of modern infrastructure, where reliability, scale, and performance matter every day. You’ll collaborate with experienced engineers across a globally distributed organisation that values openness, inclusion, technical excellence, and continuous learning. We move quickly, solve meaningful challenges, and give people the space to make an impact. If you thrive in fast-paced environments, enjoy working with advanced technology, and want to help shape the future of high-performance compute, you’ll find both challenge and opportunity here. You can also expect: Exposure to industry-leading GPU and AI infrastructureOpportunities to grow alongside a rapidly scaling global businessA collaborative, inclusive, and supportive engineering cultureReal ownership and the ability to influence operational excellenceWork that sits at the intersection of people, performance, and technologyA modern, flexible, globally connected workplace with ambitious goalsKey ResponsibilitiesOperate and improve high-density AI/HPC infrastructure in a 24/7 production environmentParticipate in a 24x7x365 on-call rotation, supporting mission-critical systems and incident responseTroubleshoot complex issues across compute, networking, storage, and orchestration layers in GPU-accelerated environmentsLead performance evaluation, testing, and operational acceptance of new HPC infrastructure before production releaseDrive continuous service improvement (CSI), reducing toil through automation, tooling, and process refinementBuild and maintain infrastructure automation and tooling (IaC and scripting) to improve reliability and operational efficiencyOptimise Linux systems for performance, including kernel, BIOS/firmware, and storage tuning for HPC workloadsConfigure and operate bare-metal infrastructure using IPMI, iLO, iDRAC, Redfish, and related toolingPartner with infrastructure tooling and observability teams to improve telemetry, alerting, and system visibility at scaleOwn ITIL-aligned processes across Incident, Major Incident, Problem, and Change Management, ensuring strong execution and continuous improvementLead root cause analysis and ensure corrective actions are implemented and automated where possiblePlay a key role in designing and delivering future HPC cluster and site builds, shaping global consistency and operational standardsCollaborate closely with Platform Engineering, Network Engineering, Infrastructure Tooling, and Data Centre Operations to improve reliability and deployment qualityFeed operational insight back into infrastructure design to influence next-generation HPC platform evolutionMentor engineers and act as a technical authority for operational best practices across teamsCommunicate clearly with technical and non-technical stakeholders, translating complex issues into actionable outcomesUphold a culture of: do, document, automateEssential Skills & Experience8+ years experience in Site Reliability Engineering, Infrastructure Engineering, or similar roles in large-scale distributed production environments operating a 24/7 support model2–3+ years recent experience in HPC and/or AI infrastructure, including GPU-based compute environments at scaleStrong Linux expertise (preferably Ubuntu), including deep systems administration and production troubleshootingProven experience in performance tuning across compute systems, including kernel, BIOS/firmware, and storage subsystem optimisationStrong hands-on experience with bare-metal infrastructure and out-of-band management tooling (IPMI, iLo, iDRAC, Redfish or equivalent)Solid networking fundamentals including TCP/IP, DNS, DHCP, VLANs, routing, and switching, with exposure to high-performance networking environmentsExposure to NVIDIA GPU ecosystems, including CUDA-based workloads and GPU-accelerated compute environments, including the NVIDIA AI reference architecture. Familiarity with high-performance networking technologies such as InfiniBand and RoCEStrong experience with infrastructure automation and scripting (e.g. Bash, Python, Ansible or similar IaC/tooling approaches)Understanding of observability principles and practical use of monitoring and telemetry systems (e.g. Prometheus, Grafana or equivalents)Understanding of workload schedulers and running workloads across multiple systems in parallel. Practical experience with at least one parallel storage platform. Experience working in ITIL-aligned environments, including Incident, Major Incident, Problem, and Change ManagementStrong troubleshooting skills in high-pressure operational environments, with a track record of incident ownership and resolutionStrong communication skills with the ability to work across engineering teams and interface with non-technical stakeholdersAbility and willingness to collaborate closely with Platform SRE teams, including exposure to and learning of Kubernetes-based orchestration environments (not a core requirement)Experience contributing to or influencing infrastructure design, reliability improvements, or operational best practices Bonus / Highly Desirable: Deep experience with HPC workloads and GPU-accelerated infrastructure at scaleExperience with InfiniBand, RoCE, or other HPC-grade networking fabrics in production environmentsExperience with HPC benchmarking, validation, or performance testing (e.g. linpac, fio, NCCL, ibdiagnet)Exposure to large-scale multi-site or global infrastructure deployments Preferred Qualifications Bachelor or Masters Level degree in Computer Science, Engineering or related field, or equivalent ‘on-the-job’ experience. LPIC CertificationsITIL Foundation level qualification or equivalent experience