AI Application Engineer - LLM & RAG

At Machine Learning Reply, we help organizations turn cutting-edge AI technologies into real-world applications and scalable digital products. To strengthen our team, we are looking for an AI Application Engineer who enjoys building AI-powered solutions and intelligent product features using modern machine learning and generative AI technologies. While our GenAI Engineers focus on model development and AI architectures, AI Application Engineers focus on building user-facing AI applications and turning AI capabilities into scalable products. In this role, you will work at the intersection of AI engineering, backend development, product development and cloud deployment, building production-ready AI systems that create real business value. Tasks As an AI Application Engineer, you design and build AI-powered applications and product features for enterprise clients. Your projects may include: Designing and developing AI applications, such as enterprise assistants, AI copilots, semantic search platforms and intelligent automation systemsBuilding LLM-powered applications using Retrieval-Augmented Generation (RAG) and modern AI frameworksDeveloping end-to-end AI products, integrating LLM APIs, enterprise data sources and backend servicesDesigning scalable AI microservices and APIs to integrate AI capabilities into enterprise platformsImplementing vector search, embeddings pipelines and knowledge retrieval systemsRapidly prototyping AI product features and proof-of-concepts and evolving them into production systemsCollaborating closely with product managers, designers, AI engineers and enterprise customers to develop impactful AI solutionsDeploying AI systems to cloud platforms and production environments using modern DevOps practicesEnsuring reliable, scalable and observable AI services through CI/CD pipelines, monitoring and containerized deployments Benefits Work in an open and collaborative environment within the global Reply network and build next-generation AI applications and intelligent digital productsCollaboration with interdisciplinary teams including AI engineers, software developers and data scientists across industries such as Banking, Insurance, Automotive and RetailA very active social program including paid training, conferences, communities of practice, hackathons and Reply XChangeMonetary Benefits include: Mobility package, Gym subsidy & WellPass, Insurance & Pension Scheme, Corporate Savings Plan, KiTa and Childcare AllowanceFlexible work arrangement between home office, EU-wide workation options, on site office-work in our downtown Munich office with access to Stammstrecke, and client on site visits with a maximum of 20% travel needs Requirements Degree in Computer Science, Software Engineering, Data Science or a comparable technical fieldConvincing communication and presentation skills in German and English in order to participate in workshops of both languagesStrong programming skills in Python and modern backend frameworksExperience building applications using AI, machine learning or generative AI technologiesFamiliarity with Retrieval-Augmented Generation (RAG) and vector databasesFamiliarity with cloud platforms such as AWS, Azure or GCPEngaging directly with enterprise clients to understand their business challenges and identify high-impact opportunities for AI-driven solutions Nice to have Experience running technical workshops or facilitating solution design sessionsExperience developing APIs, microservices and scalable backend systems, including vector databasesExperience with containerization and DevOps practices (Docker, CI/CD pipelines, Kubernetes or similar)Experience with frameworks such as LangChain, LlamaIndex or HuggingFaceExperience deploying AI services in cloud environmentsKnowledge of AI observability, monitoring, and evaluation of LLM systems Example projects you may work on Enterprise AI knowledge assistantsAI copilots for internal business toolsSemantic search platforms for enterprise dataDocument intelligence systems powered by LLMsAI agents and automation systems for enterprise workflows