Senior AI Engineer

Nlb Services — Canada · Posted ~2 hours ago

Senior Full-time

Skills

Python FastAPI AI agents RAG Vector databases LLM applications AI evaluation Production software engineering Prompt optimization LLMs LangSmith Langfuse Braintrust

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build and deploy high-precision agentic and RAG applications for complex professional workflows. You will create multi-step AI agents and end-to-end retrieval pipelines, develop clean Python backends with FastAPI, validate accuracy using evaluation datasets and hallucination metrics, optimize model costs, and work directly with domain specialists to turn workflows into production software. At least 5 years of software engineering experience and 2 years shipping production AI/LLM applications are required.

Highlights

Build production-grade agentic and RAG applications for professional services workflows. The role offers direct collaboration with domain experts, ownership of end-to-end AI systems, rigorous accuracy evaluation, and opportunities to optimize model costs and performance.

Description

Senior AI-First Engineer Location: Minneapolis, MN and Toronto, ON Type: FTE Core Focus: Design, build, and deploy high-precision agentic and RAG applications for accounting and tax clients. What You Will Do:Build multi-step AI agents and end-to-end RAG pipelines (retrieval, reranking, chunking, citation tracing).Write clean Python backends (FastAPI, async APIs, queueing, retry logic).Test and prove accuracy using golden datasets, LLM-as-a-judge, and hallucination metrics before shipping.Optimize costs using model routing, prompt caching, and context trimming.Work directly with tax accountants and auditors to turn domain workflows into working software.Requirements:5+ years in software engineering (Python/FastAPI).2+ years shipping real production AI/LLM applications (not demo projects).Background or familiarity with tax, audit, accounting, or finance platforms.Hands-on experience with vector databases, RAG, and AI eval tools (LangSmith, Langfuse, Braintrust, etc.). “All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, genetic information, or status as a protected veteran. NLB is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, contact HR department by sending an e-mail to notifications@nlbservices.com.”