Summary
✨ AI‑Generated
A technology organization is seeking a lead backend engineer to design and deliver AI-powered API services and agentic workflows. The role treats language models as components of secure, scalable distributed systems and provides ownership of architecture, API contracts, reliability, observability, evaluation, fallback strategies, and technical mentoring.
Highlights
Lead-level engineering role focused on building robust AI-powered backend services and agentic workflows. Provides substantial architectural ownership, influence over technical direction, mentorship responsibilities, and emphasis on reliability, observability, evaluation, graceful failure, and cost awareness.
Description
We are looking for a Lead Backend Developer with Python and AI expertise to drive the design and delivery of robust AI-powered API services and agentic workflows, while providing technical leadership across the team.
This role focuses on language model interaction with internal systems, vector databases, and external tools via orchestration frameworks, treating LLMs as components in a secure, scalable distributed system.
You will define technical direction, own API contracts and service reliability end-to-end, ensure AI edge cases fail gracefully, and integrate LLMs using rigorous systems engineering with built-in evaluation, observability, fallback handling, and cost awareness.
As a lead, you will also mentor engineers, shape architecture across pods, and champion engineering excellence.
Responsibilities
Lead the design and implementation of backend API services and LLM orchestration layersDefine and evolve reliable, reusable orchestration frameworks and logic for downstream developer consumptionArchitect and oversee complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimizationDrive the development and integration of agent tools using LangChain, LangGraph, and potentially MCP (Model Context Protocol)Set the standard for integrating LLMs with rigorous systems engineering, embedding evaluation, observability, fallback handling, and cost awarenessEstablish and enforce practices for security, privacy, enterprise-grade observability, and test coverage across all backend workflowsOwn API contracts and service reliability end-to-end, ensuring AI edge cases fail gracefullyLead architecture decisions and define engineering standards within and across podsMentor and coach backend engineers, conduct code reviews, and foster a culture of technical excellenceCollaborate closely with frontend engineers, data engineers, infrastructure teams, product managers, and stakeholders to align technical strategy with business goals
Requirements
Extensive backend engineering experience, with a proven track record in microservices and distributed systems5+ years of experience in Python for high-performance backend services and cloud-native APIsAt least 1 year of relevant leadership experienceDeep expertise in AWSStrong hands-on experience with Docker and ECS/EKSProven experience designing RESTful APIs and building production systems with LangChainSolid knowledge of secure coding practices and strong auth/authz fundamentalsDemonstrated experience leading engineering teams, mentoring developers, and driving architectural decisionsExcellent written and verbal communication skills in English (B2+ level)
Nice to have
Production experience with AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent)Practical experience with vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systemsFamiliarity with LlamaIndex, LangGraph, or agent interoperability patterns (MCP)Background in AI evaluation tooling or real-time APM (LangSmith, Langfuse, Arize)Experience with React and TypeScriptDeep understanding of identity/security domains (IAM, CIAM), plus experience deploying to EKS environments at scaleFlexibility to use secondary languages such as Java, Node.js, or GoExperience influencing engineering strategy at the organizational level
We offer
International projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn
EPAM is an Equal Opportunity Employer.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.