DevOps Engineer (Cloud Infrastructure & Data Platforms)

Own and evolve the cloud infrastructure behind business-critical market-data products — real-time streaming APIs, client-facing platforms, and large-scale data pipelines. About Eighteen EightEighteen Eight (www.eighteeneight.co.uk) delivers comprehensive, innovative software solutions to the global financial services industry. With deep expertise in real-time systems integration and data quality, we empower organisations to unlock maximum value from their data through cloud-ready solutions. We are recruiting on behalf of a leading provider of OTC market data seeking a DevOps Engineer to own and evolve the cloud infrastructure behind a portfolio of business-critical data products — real-time streaming APIs, client-facing platforms, and large-scale data pipelines serving global financial and commodities markets. The OpportunityYou will join a fast-moving product engineering team as the infrastructure owner across several production platforms: a real-time WebSocket trade-streaming service, client entitlement and inventory platforms, and the data pipelines that feed them. This is a hands-on role with genuine breadth — one day you're building Terraform modules for API Gateway custom domains and certificate automation, the next you're debugging an Okta JWT authorizer in production, tuning Kafka consumers on MSK, or unblocking a release pipeline. You'll work directly with product engineers and central platform teams, and your decisions will shape how these platforms scale, deploy, and stay observable. Key ResponsibilitiesInfrastructure as Code: Design, build, and maintain AWS infrastructure with Terraform — reusable modules, multi-account estates, and clean dual-run migrations with zero client downtime.CI/CD Ownership: Own GitLab CI pipelines for a large Nx monorepo and standalone services — build, test, containerise, deploy — improving speed, reliability, and release discipline.Cloud Platform Operations: Run production workloads across API Gateway (WebSocket + HTTP), Lambda, EKS/Kubernetes, MSK (Kafka), RDS/Aurora, ElastiCache, S3, and CloudFront.Identity & Access: Implement and operate Okta OIDC/OAuth integrations — app configuration, JWT authorizers, machine-to-machine token flows — and IAM/Secrets Manager hygiene across accounts.Networking & DNS: Manage Route53 zones, delegations, ACM certificates, and custom domains, coordinating with central IT/platform teams on DNS and network changes.Observability: Build the monitoring story — structured logging conventions, CloudWatch, Prometheus/Grafana dashboards, and alerting that answers "is the client actually receiving data?" before the client asks.Data Pipeline Operations: Support Airflow-orchestrated jobs, Snowflake integrations, and Kafka/Flink streaming workloads, including credentials, connectivity, and run reliability.Developer Experience: Keep local and non-prod environments honest — seed data, env management, Docker Compose setups — so engineers ship without fighting infrastructure.Incident Response: Diagnose production issues across the stack (auth failures, connectivity, delivery gaps) with a methodical, evidence-first approach. About YouEssential Qualifications & Experience4+ years in DevOps, platform, or infrastructure engineering roles.Strong Terraform expertise — modules, state management, multi-account AWS deployments.Deep hands-on AWS experience: API Gateway, Lambda, EKS, MSK/Kafka, RDS, Route53, ACM, CloudWatch, IAM.Solid GitLab CI (or equivalent) experience in monorepo environments; Docker and container registries.Working knowledge of Kubernetes operations: deployments, ingress/NLB, service accounts, IRSA.Experience with OAuth/OIDC identity providers (Okta or similar) — app integrations, token flows, authorizers.Observability tooling: Prometheus, Grafana, CloudWatch; a bias for structured logging and actionable alerts.Strong Linux, shell, and scripting skills (Python or Node.js).Clear written and verbal communication — you can explain infrastructure decisions to engineers, product managers, and central platform teams alike.Desired SkillsExperience with real-time/streaming market data platforms (WebSocket APIs, Kafka, Flink).Snowflake administration and key-pair/service-account auth patterns.Airflow operations; Nx/pnpm monorepo familiarity.Exposure to financial services or commodities data environments and their change-control cultures.Experience working alongside (and occasionally around) centralised enterprise IT — DNS delegation, certificate provisioning, network approvals. Success Criteria (First 3 Months)CI/CD pipelines measurably faster and more reliable, with deployment steps documented and repeatable.Terraform estate consolidated: no orphaned resources, clean plans, dual-run migrations completed and legacy infrastructure decommissioned.A monitoring baseline in place for client-facing streaming services — per-client delivery visibility, auth-failure alerting, and dashboards the commercial team can read. Why Join Eighteen Eight?Impact: Own the infrastructure behind revenue-generating market-data products end to end — your work ships to real clients weekly.Breadth: A genuinely full-stack platform role — streaming, identity, data pipelines, and client-facing delivery, not a single-lane ops seat.Collaboration: Work day-to-day with product engineers who move fast and value infrastructure that keeps up.Inclusivity: We are committed to fostering a diverse and inclusive workplace where everyone can thrive. What we're looking for4+ years in DevOps, platform, or infrastructure engineeringStrong Terraform: modules, state management, multi-account AWSDeep AWS: API Gateway, Lambda, EKS, MSK/Kafka, RDS, Route53, IAMGitLab CI (or equivalent) in monorepo environments; DockerKubernetes operations; OAuth/OIDC (Okta or similar)Observability: Prometheus, Grafana, CloudWatchStrong Linux, shell, and scripting (Python or Node.js)