Senior Infrastructure Engineer - AI/ML Platform

This is a Fully Remote Job 1. About Our Client: The organization operates in the AI and open-source software ecosystem, focusing on enabling enterprises and government entities to build AI systems they control and govern independently. Founded by a leading figure in scientific computing, the team leverages deep expertise from prominent open-source projects like NumPy, SciPy, PyTorch, and Jupyter. The organization addresses the challenge of AI ownership by providing platforms and tools that allow users to manage their AI data, context, and results directly, rather than relying on external vendors. 2. About the Opportunity: The Senior Infrastructure Engineer - AI/ML Platform role involves building and maintaining a Kubernetes-based platform for secure AI test and evaluation in government environments. The position supports demanding AI/ML workloads while ensuring platform reliability, security, and scalability within restricted network and accreditation boundaries. This role is critical for delivering infrastructure that meets strict operational and compliance needs, enabling government teams to assess AI systems securely and effectively. 3. Responsibilities: Build and operate Kubernetes platform supporting AI test and evaluation frameworksImplement GPU scheduling, workload orchestration, resource management, and multi-tenant isolationDesign infrastructure-as-code, GitOps workflows, and automated deployment pipelinesDevelop reusable and modular infrastructure componentsContribute to open-source Kubernetes, infrastructure, and MLOps projectsManage platform reliability, capacity planning, upgrade strategies, and operational readinessDesign and implement observability and monitoring for AI/ML workloadsDevelop operational runbooks and deployment documentationDeploy and secure infrastructure in restricted and limited-connectivity government environmentsSupport security authorization and compliance through documentation and hardened configurationsIntegrate automated security tooling such as container scanning and policy enforcementCollaborate with government stakeholders and engineering teams to translate requirementsProvide technical leadership and mentor team membersWork effectively within a remote, distributed team using asynchronous communication 4. Requirements: U.S. citizenship and ability to obtain and maintain a Secret security clearance6+ years of infrastructure, platform, DevOps, or site reliability engineering experienceStrong knowledge of scalability, reliability, observability, security, and automation principlesProduction experience with Kubernetes workload scheduling and multi-tenant environmentsExperience with automated security tooling including container scanning and policy enforcementProficiency with infrastructure-as-code tools such as Terraform, OpenTofu, or PulumiExperience with major cloud platforms (AWS, Azure, or Google Cloud) covering networking, security, storage, and computeSkills in monitoring and observability tools like OpenTelemetry, Prometheus, and GrafanaStrong programming or automation skills in Python, Go, or similar languagesExperience with CI/CD, GitOps workflows, and infrastructure automationAbility to create operational documentation and runbooksExperience leading technical initiatives and mentoring engineersAbility to work independently and collaboratively in a remote teamEffective communication and willingness to give and receive technical feedback 5. Pay Range and Compensation Package: Salary Range: $145,000 to $250,000 USD, dependent on experience level and location Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin. Note: TalentHop is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.