AI Infrastructure / MLOps Engineer — NYC
Lastellar Group — United States · Posted ~4 days ago
🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.
Log in to add to target listDescription
We are a fast-growing fintech and investment platform operating at the intersection of AI and financial markets.
Our production AI systems are live, our data platform is scaling fast, and we need someone to help us build the infrastructure that keeps it all running reliably.
This is not a research or modeling role.
You will own the systems — cloud infrastructure, CI/CD pipelines, container orchestration, agent operations, observability, and enforcement — that make our AI and data platforms reliable, scalable, and production-grade.
What You'll Own
AI Platform & Agent Operations
Operate and scale live agentic AI systems across Azure and GCP — ensuring agents are highly available, performant, and resilient under load.Build and maintain observability tooling for agent execution — logging, tracing, alerting, and performance monitoring.Support integration of agents with data platforms and Model Context Protocol (MCP) servers.Implement auto-scaling strategies for containerized agent workloads across Azure Container Apps, GCP Cloud Run, and GKE.Contribute to evaluation frameworks and quality standards for AI agents in production.MLOps & Python Engineering
Write, maintain, and improve production Python code powering data pipelines, agent workflows, and platform tooling.Own the full lifecycle of Python-based services — containerization, deployment, versioning, and runtime behavior.Deploy and operate workflow orchestration using Prefect — scheduling, error handling, retry logic, and human-in-the-loop patterns.Build shared Python tooling and internal packages that enable data science teams to develop and deploy faster.Cloud Infrastructure & CI/CD
Write and maintain Terraform across Azure and GCP — container registries, managed identities, Key Vault, GCP Secret Manager, storage backends, and VNet configurations.Build and maintain CI/CD pipelines and release management workflows across data science and engineering repositories.Enforce coding standards, security policies, and compliance controls directly in the pipeline.Ensure all production systems are well-documented with clear runbooks and data lineage.Observability & Reliability
Build and own the observability stack — metrics, logging, distributed tracing, alerting.Drive SLO/SLI frameworks and incident response as the platform matures.Troubleshoot production issues end-to-end — from application logic through to infrastructure.What We're Looking For
Required
3–5 years in software engineering, DevOps, MLOps, or platform engineering with clear production system ownership.Strong Python engineering — production-grade code, packaging, containerization, dependency management.Hands-on Docker and container orchestration experience in Azure and/or GCP.Terraform across cloud providers — you've designed it, not just configured it.Solid secrets management — Azure Key Vault, GCP Secret Manager, runtime injection patterns.CI/CD pipeline experience with Git-based release management.Systems thinker — you troubleshoot end-to-end, not just at the surface.Genuine curiosity about AI and agentic systems — excited to grow into deeper platform concepts.Strong Signal
Policy-as-code enforcement — OPA or equivalent in a production CI/CD context.
Tell us about it.Observability depth — if you describe OpenTelemetry as a specification and protocol rather than a tool, we want to talk.Experience with Azure Container Apps, ACI, ACR, Managed Identities, VNets.Experience with GCP Cloud Run, GKE, Vertex AI, IAM, Secret Manager.Familiarity with agentic frameworks — MCP, LangChain, or similar.AI observability platforms — Langfuse, MLflow, or similar.dbt, Snowflake, or similar data transformation and warehousing tools.Nice to Have
Prefect or similar workflow orchestration in production.Multi-cloud networking and identity management experience.Financial services or fintech domain exposure.
We have 65,243 jobs that might be an even better fit for you
DontApply's real value goes far beyond a single job link or company name. Just upload your resume — in under a minute we'll analyze all 65,243 jobs and tell you exactly which ones you should apply to right now.
Upload My Resume