Senior Software Engineer - AI Infrastructure

Senior Software Engineer (TypeScript / React / LLM Systems) • AI Infrastructure • $250,000 • Hybrid (2 days/week) • New York, NY Must be based in NYC & the role requires US Citizenship due to regulatory constraints. No sponsorship/visas/Green Card. About the Role We’re hiring a Senior Software Engineer to help build production-grade LLM-powered systems used in high-impact, real-world workflows. This is a true SWE + ML role. You’ll sit at the intersection of frontend UX, backend systems, and applied machine learning - owning features end to end. That includes React-heavy user interfaces, TypeScript services, and the pipelines that power LLM reasoning, retrieval and fine-tuning behind the scenes. You’ll work closely with product, design and ML engineers to ship tools where reliability, clarity and user experience matter just as much as model quality. Why You’ll Love It: Own real systems: From UX flows to LLM pipelines running in production. Engineering-first culture: Practical ML, not research theatre. Everything ships. High-impact UX: Build interfaces used daily by technical and non-technical users. Move fast: Small teams, short cycles, minimal process overhead. Serious problems: Latency, hallucination control, evaluation, observability and scale. What You’ll Do Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows.Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability.Implement retrieval systems using vector databases, hybrid search and structured data sources.Work hands-on with LLM APIs and open-source models (OpenAI, Anthropic, open-weight models).Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout.Own backend architecture across Node.js services, async pipelines and model-facing APIs.Improve system reliability through logging, monitoring, tracing and failure handling.Mentor engineers and contribute to design and architecture decisions across the platform. Tech Stack Frontend: React, TypeScript, Next.js, Tailwind CSS, Storybook Backend: Node.js, TypeScript, REST, GraphQL LLM Systems: RAG pipelines, fine-tuning workflows, prompt orchestration Data & Retrieval: PostgreSQL, Vector DBs (Pinecone, Weaviate, pgvector), Redis Infrastructure: AWS, Docker, Kubernetes, Terraform Observability: OpenTelemetry, Prometheus, Grafana, Sentry Nice to Have Experience building production LLM systems beyond prototypesHands-on fine-tuning experience (LoRA, adapters, evaluation pipelines)Background in ML engineering or applied NLPExperience designing complex frontend UX for data-heavy or AI-driven productsFamiliarity with model evaluation, guardrails and hallucination mitigation Interview Process Intro Call with Open Talent (30 mins)Technical Deep-Dive (TypeScript / React + LLM systems, 60 mins)System Design & Architecture (45 mins)Leadership Chat with CTO (30 mins) → Offer What We Offer Comp: $160K-$240K W-2 (+ meaningful equity) Benefits: Health, dental, vision, 401(k) Time Off: Flexible PTO + company holidays Growth: Conference budget, learning allowance Environment: Hybrid (2 days NYC office), flexible notice period Equal Opportunity We're hiring for an Equal Opportunity Employer. Due to strong market interest, please apply early or email sufy@opentalent.uk to avoid missing out. All NYC roles posted here first: linkedin.com/in/sufyanbashir/