Description
Software Engineer Full Stack & AI Infrastructure
Firmly · Forest Hills, Queens, NY · Onsite · Full-time
About Firmly
Firmly is building the Law Firm Operating System, an AI-native platform designed to replace the disconnected software, files, and manual workflows law firms rely on today.
A major part of the platform is the development of specialized AI systems built for specific legal and operational tasks, with secure access to a firm's documents, data, and internal knowledge.
The Role
We are looking for an engineer who can work across full-stack development, AI infrastructure, and production systems.You will work directly with the founder, who leads product direction and architecture.
Your job is to turn detailed requirements into reliable production software and help build the infrastructure behind Firmly's AI systems.This is not just a web-development role.
A major part of the job will involve open-source AI models, self-hosted inference, secure data access, sandboxing, retrieval systems, and AI infrastructure.
What You'll Do
Build and ship features in our Next.js, React, TypeScript, and PostgreSQL applicationDeploy and operate open-source LLMsBuild specialized AI systems for narrowly defined legal and operational tasksConnect AI securely to firm documents, databases, and file repositoriesBuild RAG, semantic search, embeddings, document ingestion, and retrieval pipelinesDesign permission-aware AI access to sensitive firm informationBuild sandboxed environments for AI tools, agents, and generated codeManage containers, model-serving infrastructure, deployments, and production issuesBuild and maintain authentication, permissions, sessions, APIs, and database systemsReview and improve both human-written and AI-generated codeOwn problems from diagnosis through resolution
The Stack
Application:
Next.js 15 · React 19 · TypeScript · Tailwind · shadcn/ui · PostgreSQL
AI / Infrastructure:
Open-source LLMs · RAG · Embeddings · Vector Search · Docker · Linux · GPU Inference · Sandboxing · Model ServingThe stack is not locked in.
We want someone capable of evaluating technologies and making sound architectural decisions.
You're a Strong Fit If You
Have 3+ years of professional software engineering experienceAre strong in TypeScript, React, backend development, and PostgreSQLAre comfortable with Linux, Docker, networking, deployment, and production infrastructureHave experience deploying or working with open-source language modelsUnderstand RAG, embeddings, semantic search, and document retrievalUnderstand authentication, authorization, permissions, and data-access boundariesCan design secure, sandboxed systems for AI executionCan move between frontend, backend, database, infrastructure, and AI workKnow how to debug complex systems without saying, “that's not my layer”Use AI coding tools effectively while still understanding and verifying the code they produceCare about shipping software that is secure, tested, reliable, and actually works
Especially Valuable
Experience with technologies such as vLLM, llama.cpp, Ollama, SGLang, Llama, GLM, Qwen, Mistral, DeepSeek, pgvector, CUDA, GPU infrastructure, model quantization, fine-tuning, or agentic systems is a major plus.
Location
Full-time, onsite in Forest Hills, Queens, New York.
Compensation
$100,000–$150,000 per year, depending on experience and demonstrated technical ability.
