Member of Technical Staff, Infrastructure

Jackandjillai — United States · Posted ~1 day ago

Senior Visa History ✓ $120000-$250000 + Equity

Skills

cloud infrastructure GPU infrastructure ML inference systems high-performance systems reliability scalability cost optimization Cloud infrastructure GPU Machine learning inference

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

An early-stage AI infrastructure startup is seeking a technical infrastructure specialist to own end-to-end cloud infrastructure for a high-performance machine-learning API. You will build global, low-latency GPU inference systems on the critical path of customer traffic while driving reliability, scalability, and cost efficiency. The role offers $120,000–$250,000 plus equity.

Highlights

High-impact infrastructure role with substantial compensation and equity at an early-stage startup, offering ownership of global low-latency GPU infrastructure and direct influence over reliability, scalability, and cost efficiency.

Description

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack. Job Title Member of Technical Staff, Infrastructure Salary $120K – $250K + Equity Company Description The Token Company is a $12M seed-stage startup backed by First Round Capital, NEA, and YC, building specialized machine learning models to compress LLM inputs. By identifying and removing unimportant data before it hits expensive models, they drastically reduce inference costs for high-scale enterprises and tech companies integrating LLMs into their production workflows. Job Description You will own the end-to-end cloud infrastructure for a high-performance compression API. This role involves building global, low-latency GPU ML inference systems that sit directly in the critical path of customer traffic. As a core member of a 5-person team, you will drive reliability, scalability, and cost-efficiency for a revolutionary AI product. Location San Francisco, USA Why this role is remarkable Join an elite 5-person team backed by $12M from top-tier investors like First Round Capital and founders of Dropbox, Slack, and Supercell.Solve critical infrastructure challenges for LLM efficiency, building the low-latency systems that enable enterprises to scale AI cost-effectively.Benefit from an unparalleled San Francisco living experience with provided housing, food, laundry, and cleaning services, plus full visa sponsorship. What You Will Do Architect and manage global, high-throughput GPU inference infrastructure using AWS, Terraform, and Docker to ensure maximum performance and uptime.Own the entire infrastructure stack from initial deployment and CI/CD pipelines to long-term reliability and cost-efficiency research.Collaborate closely with research and product teams to integrate and scale compression models into a high-traffic production API. The ideal candidate Demonstrated experience building and operating production-grade cloud infrastructure at scale using tools like AWS and Terraform.Strong background in managing containerized environments with Docker and establishing robust CI/CD pipelines for high-reliability systems.Proven ability to take end-to-end ownership of an infrastructure stack, ideally within a fast-paced startup or high-growth engineering environment. Who are Jack & Jill? Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support. And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate. How does this work? Jack's an AI agent for job searching and career coaching. He works for you.Jill is the AI recruiter working for the company. She recruits from Jack's network.If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives. We never post fake jobs This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network. Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description. We appreciate this can make them look a bit suspect, but there isn't much we can do about it. Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.