Software Engineer - AI Platform

SOFTWARE ENGINEER – AI ENGINE Location: Remote within Germany or the European Union Company location: Berlin, Germany Employment type: Full-time, permanent Salary: €80,000–€120,000 gross per year, depending on experience Industry: Artificial Intelligence ABOUT US Our client is a Berlin-based AI company building intelligent software that helps organizations automate complex work, make better decisions and create new AI-powered products. Our core technology is an AI engine that combines large language models, proprietary data, retrieval systems, orchestration and evaluation tools. We are looking for a Software Engineer who can help us turn advanced AI capabilities into a reliable, scalable and secure production platform. This is a remote position. You will collaborate with colleagues in Berlin and across Europe while having a high degree of autonomy over how you organize your work. ABOUT THE ROLE As a Software Engineer working on our AI engine, you will design, build and operate the services that power our AI products. You will work at the intersection of backend engineering, machine learning infrastructure and product development. Your responsibilities will include integrating foundation models, developing APIs and orchestration systems, improving retrieval and evaluation pipelines, and ensuring that the platform performs reliably in production. This is an engineering role rather than a pure research position. You should be interested in converting rapidly developing AI technology into maintainable products that solve real customer problems. YOUR RESPONSIBILITIES • Design, build and maintain the core services of our AI engine. • Develop scalable backend systems, APIs and data-processing pipelines. • Integrate commercial and open-source language models into production applications. • Build model-routing, prompt-management and workflow-orchestration capabilities. • Develop retrieval-augmented generation systems using structured and unstructured data. • Create automated evaluation frameworks for measuring accuracy, quality, latency, safety and cost. • Improve observability, monitoring, logging and incident-response capabilities. • Optimize system performance, infrastructure utilization and model-inference costs. • Work with product managers, machine learning engineers and designers to translate customer needs into technical solutions. • Contribute to architecture decisions, technical documentation and engineering standards. • Write reliable, well-tested and maintainable code. • Review code and provide constructive feedback to other engineers. • Investigate production issues and implement sustainable corrective actions. • Support security, privacy and responsible-AI requirements throughout the development lifecycle. • Stay informed about relevant developments in AI engineering and evaluate them pragmatically. WHAT WE ARE LOOKING FOR • Several years of professional software-engineering experience. • Strong programming skills in Python. • Experience designing and operating backend services and APIs. • Good understanding of software architecture, data structures and distributed systems. • Experience with relational databases and data-modelling principles. • Familiarity with cloud infrastructure and containerized applications. • Experience writing automated tests and using continuous integration and deployment workflows. • Ability to diagnose complex technical problems systematically. • Strong ownership and a focus on delivering reliable production systems. • Clear written and spoken English communication skills. • Ability to work independently in a remote environment and collaborate effectively across functions. VALUABLE ADDITIONAL EXPERIENCE You do not need to meet every item below. Experience in any of these areas would be valuable: • Production applications using large language models. • Retrieval-augmented generation, vector databases or semantic search. • AI agents, tool use or multi-step workflow orchestration. • Prompt management and model-evaluation systems. • Open-source model deployment and inference optimization. • Machine learning operations or model-serving infrastructure. • Kubernetes, Terraform or comparable infrastructure technologies. • AWS, Google Cloud Platform or Microsoft Azure. • Event-driven architecture and message queues. • Security, privacy or compliance requirements for AI systems. • Monitoring tools such as OpenTelemetry, Prometheus or Grafana. • Experience working in an early-stage or rapidly growing technology company. HOW WE WORK • Remote-first collaboration with clear written communication. • High trust, personal ownership and limited bureaucracy. • Small, cross-functional teams with direct access to decision-makers. • Pragmatic engineering focused on measurable customer value. • Short development cycles and frequent production releases. • Constructive technical debate without unnecessary hierarchy. • Responsible use of AI, with attention to security, privacy and transparency. WHAT WE OFFER • A salary of €80,000–€120,000 gross per year, based on experience, technical scope and expected level of responsibility. • A permanent, full-time employment contract. • Remote work within supported European locations. • Flexible working hours with agreed periods for team collaboration. • Modern equipment and a home-office budget. • Regular opportunities to meet the team in Berlin. • Professional-development and conference budget. • Direct influence over the architecture and direction of the company’s core AI platform. • The opportunity to work with modern AI technologies on real production use cases. • A supportive international team with a strong engineering culture. HIRING PROCESS Our selection process normally includes: Introductory conversation with the recruitment or people team.Technical conversation with members of the engineering team.Practical technical exercise or collaborative system-design session.Final conversation covering team fit, expectations and employment conditions.We aim to communicate decisions clearly and keep the process efficient. Candidates will be informed in advance about each stage and its expected duration. EQUAL OPPORTUNITY If you are interested in building dependable AI systems and shaping the technical foundation of a growing Berlin AI company, we would be pleased to hear from you.