Senior HPC and Data Storage Engineer

J Craig Venter Institute — United States · Posted ~3 hours ago

Senior Full-time

Skills

HPC Linux administration data storage Ceph cloud infrastructure virtualization infrastructure automation backup and disaster recovery Linux cloud

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A research-focused organization seeks a senior infrastructure engineer to maintain and optimize high-performance computing and large-scale storage environments supporting scientific workloads.

Highlights

Support advanced scientific computing environments by optimizing large-scale infrastructure and research data platforms.

Description

Position Summary The J. Craig Venter Institute (JCVI) is a global nonprofit genomic research organization dedicated to advancing the science of genomics, human health, and environmental biology through innovative research and technology. The Sr. High Performance Computing (HPC) & Data Storage Engineer will support, maintain, and optimize computing and data storage infrastructure supporting bioinformatics, genomics, research computing, and scientific applications. This position is responsible for HPC infrastructure, large-scale data storage, Ceph, Linux systems administration, cloud infrastructure, virtualization, infrastructure automation, backup, and disaster recovery. The HPC and Data Storage Engineer will work closely with bioinformatics scientists, software engineers, laboratory personnel, and technical leadership to maintain reliable, scalable, and high-performance computing environments capable of supporting large and rapidly growing scientific datasets. This position will require deep Linux and storage expertise and experience supporting HPC or other data-intensive computing environments. AWS cloud and Kubernetes experience are highly desirable as the organization's infrastructure continues to evolve. Position Responsibilities HPC & Research Computing Support, maintain, and optimize high-performance computing (HPC) infrastructure supporting bioinformatics, genomics, and data-intensive scientific workloads. Administer HPC compute nodes and supporting Linux infrastructure. Monitor and optimize system performance, resource utilization, and availability. Support scientific software and computational environments used for genomic sequencing and analysis. Troubleshoot performance issues involving compute, storage, and applications. Support workload scheduling environments such as Slurm or similar HPC schedulers. Partner with bioinformatics and software engineering teams to optimize computational workflows and infrastructure. Participate in HPC capacity planning and infrastructure architecture decisions. Data Storage Administer, maintain, and optimize large-scale storage infrastructure supporting HPC and scientific computing workloads. Deploy, administer, monitor, and troubleshoot Ceph distributed storage environments. Manage high-capacity research storage, Linux file systems, and shared storage resources. Support block, object, file, parallel, and distributed storage technologies. Monitor and optimize storage capacity, throughput, latency, I/O performance, availability, and system health, and troubleshoot complex storage performance issues. Perform capacity planning to support rapidly growing scientific datasets. Support storage migrations, upgrades, lifecycle management, and high-speed data movement. Maintain backup, replication, archival, and disaster recovery solutions, including periodic recovery testing. Linux Systems Administration Administer enterprise Linux systems including Red Hat Enterprise Linux, Rocky Linux, Ubuntu, Amazon Linux, or similar distributions. Install, configure, patch, upgrade, monitor, and maintain physical and virtual Linux servers. Configure file systems, storage mounts, system resources, and services. Troubleshoot complex operating system, hardware, storage, and application issues. Perform Linux performance analysis and tuning for compute- and data-intensive workloads. Administer and support virtualization technologies. AWS Cloud & Containers Support AWS and hybrid cloud infrastructure, including cloud-hosted Linux compute and storage resources. Work with AWS services such as EC2, S3, EBS, FSx, VPC, CloudWatch, and related technologies. Support integration between on-premises HPC/storage infrastructure and cloud resources. Assist with cloud architecture, resource provisioning, performance optimization, and cost management. Support containerized workloads using Docker. Support or assist with Kubernetes platforms such as Amazon EKS, including integration with persistent storage technologies such as Ceph. Automation & Collaboration Automate infrastructure provisioning, configuration, monitoring, and maintenance using Bash, Python, or similar technologies. Support Git-based infrastructure and CI/CD workflows where appropriate. Collaborate closely with bioinformatics scientists, software engineers, laboratory personnel, and technical leadership. Translate scientific computing and data requirements into practical infrastructure solutions. Perform root-cause analysis for significant infrastructure and performance problems. Develop and maintain technical documentation, procedures, and system configurations. Evaluate emerging HPC, storage, cloud, and infrastructure technologies. Required Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical field, or equivalent professional experience. 7+ years of experience administering enterprise Linux environments, with strong systems administration and troubleshooting expertise. Experience supporting large-scale data storage environments. Experience with Ceph or comparable distributed storage technologies. Experience supporting HPC, research computing, scientific computing, or other data-intensive environments. Experience with AWS or hybrid cloud environments. Experience with virtualization technologies. Strong understanding of storage technologies, Linux file systems, backup, replication, and disaster recovery. Experience with Bash and/or Python scripting. Experience with Docker or similar container technologies. Familiarity with Kubernetes and container orchestration. Strong analytical, documentation, communication, and troubleshooting skills. Preferred Qualifications Experience supporting bioinformatics, genomics, life sciences, or scientific research. Experience administering large-scale HPC clusters. Experience with Ceph, including administration, performance tuning, and troubleshooting. Experience with Slurm or other HPC workload schedulers. Experience with parallel/distributed file systems and large-scale research storage. AWS experience, particularly with compute and storage services. Experience operating Kubernetes, Amazon EKS, or similar container orchestration platforms. Experience integrating Kubernetes with Ceph or other persistent storage platforms. Experience with high-speed networking and large-scale scientific data movement. Experience supporting hybrid on-premises/cloud HPC environments. Required Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience. 7+ years administering enterprise Linux environments. Experience supporting VMware and virtualization. Experience supporting AWS or hybrid cloud environments. Strong Linux administration skills. Networking fundamentals. Bash and/or Python scripting. Docker and Kubernetes experience. Excellent troubleshooting and communication skills. Backup and disaster recovery. Preferred Requirements Experience supporting genomics, bioinformatics, or life sciences research. Experience administering HPC clusters. Experience with Slurm or other workload schedulers. Experience with parallel file systems or large-scale storage. Experience supporting scientific computing. Experience with Ansible, Terraform, or similar automation tools. Experience with GitHub and CI/CD workflows. Work Environment This position operates in a highly collaborative genomics and laboratory environment and may require interaction with laboratory operations, software engineering, bioinformatics, and executive leadership teams. Hybrid or onsite presence may be required based on operational needs. The work environment characteristics described here are representative of those a teammate encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Moderate noise (i.e. business office with computers, phone, and printers, light traffic) Ability to work in a confined area. Ability to sit at a computer terminal for an extended period of time. Physical Demands The physical demands described here are representative of those that must be met to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to, stand, sit; talk, hear, and use hands and fingers to operate a computer and telephone keyboard reach, stoop kneel to install computer equipment. Specific vision abilities required by this job include close vision requirements due to computer work. Light to moderate lifting is required. J. Craig Venter Institute is an Equal Opportunity Employer. All qualified applicants are encouraged to apply and will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other legally protected characteristic or status.