Senior AI Quality Assurance Engineer

Jackandjillai — United Kingdom · Posted ~3 days ago

Senior Full-time Visa History ✓ £60000-£70000 per year

Skills

QA strategy AI system testing LLM testing Non-deterministic output validation Automated testing TypeScript Microservices API testing AWS Performance testing K6 CI/CD Observability Datadog Distributed systems LLMs

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary

Lead quality engineering for an AI-driven financial technology platform serving a large user base. You will define end-to-end quality strategy for non-deterministic, LLM-powered features, build automated testing frameworks for TypeScript microservices and APIs on AWS, and own performance testing for distributed systems. The role focuses on validating probabilistic AI behavior, managing hallucination risks, scoring output quality, and improving observability. Candidates should have 7+ years of QA experience, a track record of owning quality strategy for complex service-oriented architectures, strong TypeScript or comparable programming skills, and hands-on experience with automated testing, AWS infrastructure, microservices, and performance testing.

Highlights

High-impact senior role with strong compensation, significant ownership of AI quality strategy, the opportunity to solve novel testing challenges for probabilistic systems, and a fast-moving environment that rewards independence and technical leadership.

Description

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack. Job Title Senior AI QA Engineer Salary £60,000-£70,000 Company Description Chip Financial Ltd is an FCA-regulated high-growth fintech building the UK’s premier investment super app for over 500,000 users. Focused on AI-driven wealth management, the company is scaling its platform to offer intelligent, personalized financial tools within a robust, distributed microservices architecture on AWS. Job Description Join Chip Financial Ltd to lead quality for our AI-driven wealth management platform. You will own the strategy for non-deterministic, LLM-powered features, building automation frameworks and performance testing suites across a TypeScript microservices architecture. This is a high-impact role for an engineer who excels at shifting quality left in a fast-paced environment. Location London, UK Why this role is remarkable Lead the quality strategy for a cutting-edge investment super app, moving beyond traditional test cases to shape how a regulated fintech delivers AI-driven personalization.Tackle unique engineering challenges by validating non-deterministic agentic systems, managing LLM hallucinations, and ensuring safety in a probabilistic wealth management environment.Join a high-traction, FCA-regulated scale-up with 500k+ users and a fast-moving culture that rewards ownership, independence, and an early Friday finish. What You Will Do Define and execute the end-to-end quality strategy for the Wealth Management business line, embedding testing early in the architecture and product design phases.Architect and scale automated testing frameworks for TypeScript microservices and APIs on AWS, enabling developer self-sufficiency and maintaining high-velocity CI/CD pipelines.Own performance testing using tools like K6 to design realistic load models, analyze results, and partner with engineering to optimize distributed system reliability. The ideal candidate Brings over 7 years of QA experience with a track record of owning quality strategy for complex, modern service-oriented architectures rather than just executing plans.Possesses deep technical proficiency in TypeScript or a similar language, with hands-on experience building automated test suites for distributed microservices and AWS infrastructure.Demonstrates a strong understanding of testing AI systems, including validation strategies for non-deterministic outputs, output quality scoring, and proactive observability using tools like Datadog. Who are Jack & Jill? Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support. And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate. How does this work? Jack's an AI agent for job searching and career coaching. He works for you.Jill is the AI recruiter working for the company. She recruits from Jack's network.If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives. We never post fake jobs This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network. Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description. We appreciate this can make them look a bit suspect, but there isn't much we can do about it. Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.