Senior Backend AI Engineer

About Us Coderio designs and delivers scalable digital solutions for global companies. We combine strong technical expertise with a product mindset to lead complex software initiatives end-to-end. We work with international clients, value autonomy and clear communication, and build long-term partnerships through technical excellence. 🌍 More information: http://coderio.com We are seeking an autonomous Senior Backend AI Engineer with 5+ years of software engineering experience and 2+ years dedicated to applied AI/LLM production systems. You should be a strong Python backend engineer who takes end-to-end ownership of systems, proactively solves complex engineering problems, and operates with a high degree of independence. You will join an agile project pod working alongside a Product Owner and Senior Engineers to build high-performance backend infrastructure that powers live AI products. What You Can Expect (Responsibilities) Refactor, maintain, and scale the core backend and AI framework layers of the platform, eliminating technical debt to support multi-tenant growth. Implement and monitor production LLM observability, focusing on token cost optimization, retrieval strategy tuning, and real-time model/data drift detection. Build and manage automated prompt versioning systems, A/B testing pipelines, and LLM evaluation frameworks to ensure high response quality and consistency. Build out next-generation copilot services and agentic workflows that autonomously produce structured communications (emails, text messages, and call scripts). Deliver reliable Python backend services, integrations, and APIs that interact directly with vector databases (Pinecone) and LLM providers. Drive features from concept to production, working directly within client cloud environments while maintaining strong code quality and operational standards. Requirements 5+ years of overall software development experience with a heavy focus on backend systems3+ years of production-level engineering experience with Python2+ years of hands-on experience building, deploying, and maintaining Retrieval-Augmented Generation (RAG) systems in live production environments1+ years of hands-on experience integrating and utilizing LLM observability and tracing tools (e.g., LangFuse, LangSmith, or equivalent platforms)1+ years of experience establishing prompt versioning, A/B testing, and evaluation frameworks for LLMs1+ years of experience implementing data drift and model drift monitoring for production AI workloadsTrack record of operating as a true senior engineer—taking direct ownership of deliverables, resolving ambiguity, and driving technical execution without waiting for step-by-step instructionsFluent English (spoken and written) for daily technical collaboration with US-based teams. Nice to Have 1+ years of experience developing agentic applications or copilot workflows (e.g., LangGraph, AutoGen, or custom agent frameworks) for automated content generation1+ years of hands-on experience with vector databases, specifically PineconeExperience with token cost management and retrieval optimization at scaleBackground in the EdTech sector or working on plugin-based integrations Benefits 100% remote work. Long-term engagement with high impact and autonomy. Strategic and high-visibility role within a modern engineering culture. Opportunity to influence technical and business strategy. Collaborative international team with strong technical leadership. Clear growth path and leadership opportunities within Coderio. Why join Coderio? At Coderio, we value talent and excellence. While we are primarily a remote-first company, this specific strategic role offers the opportunity to work directly on-site to drive high-stakes initiatives. We are passionate about technology, collaboration, and fair compensation. We offer an inclusive and challenging environment with real growth opportunities. If you are motivated to design solutions that make a difference, we are waiting for you. Apply now. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.