Summary
✨ AI‑Generated
An experienced AI platform engineer is sought to build and operate the observability, reliability, governance, and platform foundations behind enterprise GenAI and agentic applications. You will implement end-to-end telemetry with OpenTelemetry and Langfuse, work with LLM gateways, model routing, MCP servers and agent runtimes, and monitor latency, errors, metrics, logs, and distributed traces. This is a long-term remote role open within Canada.
Highlights
Long-term remote opportunity focused on building reliable, observable, and governed infrastructure for enterprise generative AI and agentic applications. The role offers exposure to modern AI platform technologies and end-to-end observability practices.
Description
About GSPANN
Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients.
We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and.
With five global delivery centers and 2000+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm.
Role: AI Observability & Platform Engineer
Location : Remote-(Canada)
Duration: Long term
Role Overview
We are looking for an experienced AI Observability & Platform Engineer to build and operate the observability, reliability, governance, and platform capabilities supporting enterprise GenAI and agentic applications.
Key Responsibilities
Build and operate observability for LLM gateways, model routing, MCP servers, agent runtimes, and AI platform services.Implement end-to-end telemetry using OpenTelemetry, Langfuse, metrics, logs, and distributed tracing.Monitor and analyze LLM/agent latency, errors, token usage, model performance, quality, evaluation results, and production behavior.Develop dashboards, alerts, and reporting for AI reliability, performance, quality, and operational health.Build AI cost and usage observability, including attribution by application, team, user, model, workflow, and environment across providers such as OpenAI, Anthropic, and Gemini.Establish observability and evaluation standards for LLM and agentic applications, including traces, prompts, responses, tool calls, evaluations, and regression signals.Support AI evaluation and monitoring through golden datasets, scoring, prompt/model comparisons, and production quality checks.Operate AI platform services on Kubernetes using Helm, Kustomize, GitOps, autoscaling, and progressive/zero-downtime deployments.Implement platform security, access control, secrets management, PII protection, guardrails, and audit logging.Enable observability across MCP, LangChain, LangGraph, CrewAI, Google ADK, and other agent frameworks.Build self-service capabilities, templates, and automation that allow development teams to onboard AI applications and agents efficiently.Partner with engineering teams to turn observability insights into platform improvements, reliability enhancements, and cost optimization.
Technical Environment:
AI/LLM Observability: Langfuse, OpenTelemetry, LLM tracing, AI evaluationAI Platforms: LLM gateways, model routing, MCP, agentic AICloud/Platform: Kubernetes, Helm, Kustomize, GitOps, APIsMonitoring: Prometheus, Grafana, Datadog or similar platformsAI/ML: OpenAI, Anthropic, Gemini, LangChain, LangGraph, CrewAI, Google ADKEngineering: Python/Java/Go, REST APIs, CI/CDSecurity: OAuth2/OIDC, JWT, RBAC, secrets management, PII/AI guardrails
Working at GSPANN
GSPANN is a diverse, prosperous, and rewarding place to work.
We provide competitive benefits, educational assistance, and career growth opportunities to our employees.
Every employee is valued for their talent and contribution.
Working with us will give you an opportunity to work globally with some of the best brands in the industry.
The company does and will take affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans and to treat qualified individuals without discrimination based on their physical or mental disability status.
GSPANN is an equal opportunity employer for minorities/females/veterans/disabled.
