LLMops Engineer

About Us At Arada, we create communities that inspire healthier, happier and more meaningful lives. Through innovative developments, exceptional customer experiences and a commitment to sustainability, we are shaping places where people can live, work and thrive. Joining Arada means becoming part of a collaborative, ambitious and forward-thinking team dedicated to delivering excellence across every aspect of our business. Role Purpose Own the infrastructure, deployment pipelines, and operational reliability of the organization's AI/LLM stack — from model access and cost governance to monitoring, guardrails, and incident response — so every AI feature the team ships run safely and predictably in production. Key Responsibilities Build and maintain CI/CD pipelines for AI application and agent deployment Stand up monitoring, logging, tracing, and alerting for LLM usage, latency, quality, and cost Manage model/API access, API keys, rate limits, and multi-vendor LLM integrations Implement guardrails, evaluation gates, and safety checks as part of deployment pipelines Own infrastructure-as-code for AI services (containers, orchestration, secrets management) Partner with AI Engineers to produce models, RAG pipelines, and agent workflows Drive cost optimization across inference, vector storage, and compute Own incident response and rollback procedures for AI-powered production features Tech Stack IaC & orchestration: Terraform, Docker, Kubernetes/AKS CI/CD: GitHub Actions, Azure DevOps Cloud: Azure (primary) AKS, App Services, Key Vault, Monitor Observability: Grafana, Prometheus, Azure Monitor/Application Insights, Datadog LLM observability/eval: Langfuse, LangSmith, PromptFoo API gateway/rate limiting: Azure API Management or Kong Scripting: Python, Bash Secrets/security: Key Vault, HashiCorp Vault Cutting-Edge AI Skills LLMOps pipeline design: prompt/version control, canary releases, eval gates before promotion Guardrail and safety-filter deployment (PII redaction, content filters, jailbreak detection) Cost governance across multiple LLM providers: token budgeting, model routing, caching Observability for non-deterministic systems: quality drift detection, hallucination monitoring Vector database operations (indexing, refresh cadence, embedding versioning) Incident response playbooks specific to AI/agent failures (runaway loops, tool misuse) Business Domain Exposure The organization is a large-scale master real estate developer delivering mixed-use residential, commercial, and hospitality communities across multiple master-planned developments, alongside affiliated retail, wellness/fitness, food & beverage, hospitality, education, and property-management operating brands. Operating AI services that touch buyer/investor-facing channels — uptime and safety are business-critical Supporting AI integrations across sales/CRM (Salesforce) and finance/procurement (ERP) systems Ensuring cost and performance governance as AI usage scales across multiple community/project teams What You'll Bring Skill, Knowledge & Experience Must-Have Requirements Strong background in DevOps/MLOps (CI/CD, IaC, containers, Kubernetes) Experience operating LLM/AI workloads in production, not just training pipelines Familiarity with observability stacks (Grafana, Prometheus, Datadog, or similar) Scripting proficiency (Python, Bash) and Azure (or equivalent cloud) experience Understanding of API gateways, rate limiting, and cost governance for AI services Nice to Have Experience with dedicated LLM evaluation/observability platforms (Langfuse, LangSmith) Security/compliance background for AI systems handling customer data Experience supporting multiple AI vendor integrations concurrently Using GenAI in Your Application Process To support a fair and consistent experience for all candidates, we ask that assessments and interviews are completed independently and without assistance from generative AI tools. This ensures we understand your strengths, your thinking, and how you approach real situations. Why join Arada? At Arada, you'll have the opportunity to contribute to projects that transform communities while working alongside talented professionals in a culture that values innovation, collaboration and continuous growth. We are committed to creating an inclusive workplace where everyone has the opportunity to thrive and make a meaningful impact. Equal Opportunity Statement Arada is committed to creating a diverse and inclusive workplace. We welcome applications from all qualified individuals and make employment decisions based on merit, experience and business needs.