Senior Infrastructure Engineer

Senior Infrastructure Engineer (GPUaaS – AI Neocloud) 📍 EMEA | Remote Sharon AI is building the infrastructure powering the next generation of artificial intelligence. Operating across high-performance GPU compute and AI infrastructure, we’re focused on delivering reliable, scalable and secure solutions that support advanced AI workloads. As Sharon AI continues to grow, we’re looking for an experienced Senior Infrastructure Engineer to join our team and help build, operate and continuously improve the core infrastructure powering our GPU-as-a-Service (GPUaaS) platform. Reporting to the Infrastructure Engineering Team Lead, you’ll work across large-scale, multi-tenant infrastructure supporting demanding AI/ML workloads, including large-scale training, fine-tuning and real-time inference. You’ll work closely with platform engineers, ML engineers and product stakeholders to ensure our infrastructure delivers the performance, reliability and efficiency required at scale. This is a hands-on senior technical role suited to an experienced infrastructure, platform or SRE engineer who enjoys solving complex technical challenges and working in fast-paced, AI-native environments. What You’ll Be Doing Build and operate large-scale, multi-tenant infrastructure supporting GPUaaS platformsManage high-performance compute clusters using Kubernetes and/or HPC schedulers such as SlurmBuild and maintain GPU-optimised infrastructure, including node lifecycle management and cluster scalingDevelop and maintain Infrastructure-as-Code using Terraform, Ansible or similar toolsAutomate infrastructure provisioning, scaling and configurationImprove GPU utilisation, scheduling efficiency and infrastructure cost optimisationBuild and enhance observability across monitoring, logging and alertingEnsure high availability, fault tolerance and disaster recovery capabilitiesImplement and maintain security controls and workload isolation across multi-tenant environmentsPartner with ML and platform teams to optimise infrastructure performance for training and inference workloadsProvide L3 support for complex platform and infrastructure incidents during standard EMEA working hoursParticipate in incident response, conduct root cause analysis and drive ongoing reliability improvementsContribute to capacity planning and broader infrastructure improvements What We’re Looking For 6–10+ years of experience in infrastructure engineering, platform engineering or SRE rolesDeep expertise across cloud and/or bare-metal infrastructure environmentsAdvanced knowledge of distributed systems and operating infrastructure at scaleStrong hands-on experience with Kubernetes and container orchestrationExperience managing or optimising GPU-based systems and workloadsStrong proficiency with Infrastructure-as-Code tools such as Terraform, Ansible or similarStrong programming and scripting skills in Python, Go and/or BashExperience with networking and storage systems in high-performance environmentsStrong observability and performance tuning capabilitiesProven ability to optimise infrastructure for cost, performance and efficiencyA security-first mindset, with knowledge of infrastructure hardening practicesStrong communication, collaboration and technical leadership skillsProven experience operating large-scale distributed infrastructure systemsHands-on experience with production-grade Kubernetes platformsExperience with automation, CI/CD and infrastructure lifecycle managementA Bachelor’s degree in Computer Science, Engineering or a related field, or equivalent experience What Would Be a Plus Experience in any of the following areas would be highly regarded: GPUaaS, IaaS or neocloud platformsAI/ML workloads and frameworks such as PyTorch or TensorFlowHPC environments and schedulers including Slurm or RayGPU technologies including CUDA, NCCL or MIGPlatforms such as Kubeflow, Airflow or similar orchestration toolsHigh-performance networking technologies such as RDMA or InfiniBandRelevant cloud or Kubernetes certifications Why Join Sharon AI? You’ll be joining a rapidly growing technology business working at the forefront of AI infrastructure. This is an opportunity to work on technically complex infrastructure challenges and play a key role in building the platform that supports the next generation of AI workloads. Remote-first working environment across EMEAWork directly with high-performance GPU infrastructure and AI/ML workloadsOpportunity to work on large-scale distributed systems and production-grade platformsExposure to GPUaaS, neocloud and next-generation AI infrastructureWork closely with platform, ML and product teamsOpportunity to make a meaningful impact on platform reliability, performance and scalability If you’re an experienced infrastructure engineer who enjoys working at scale, solving complex technical problems and wants to help build the infrastructure behind the next generation of AI, we’d love to hear from you.