Platform Engineer - Agent Promotion & Rollback

Intellias โ€” Poland ยท Posted ~4 hours ago

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Description

We are looking for a Platform Engineer to build and automate agent deployment, promotion, and rollback capabilities for an enterprise AI Agent Platform being developed from the ground up. The role will focus on creating reliable multi-environment release workflows for AI agents, introducing automated quality gates, version management, regression validation, and safe rollback mechanisms to ensure agents can progress from development to production in a controlled and predictable way. About the Client Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business. About the Project The project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases. The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution. Responsibilities Design and implement agent promotion workflows across development, QA, and production environments.Build automated quality gates that validate agents before promotion to higher environments.Implement rollback mechanisms to safely restore previous production agent versions.Automate post-deployment validation including health checks and smoke tests.Manage AWS AgentCore Runtime versions and endpoints to support environment-specific deployments.Build Python automation for agent deployment, promotion, versioning, and rollback operations.Integrate agent evaluation results into deployment pipelines to prevent releases that fail quality, safety, or workflow accuracy checks.Implement agent version comparison and regression testing using consistent evaluation suites.Support safe deployment strategies such as blue/green and canary patterns for AI agents.Monitor agent health following deployments and support automated detection of release issues.Collaborate with AI and platform engineering teams to establish reliable CI/CD and lifecycle management practices for agents. Qualifications Skills: Agent promotion workflow โ€” environment progression (dev โ†’ qa โ†’ prod) with evaluation gate enforcementAgent rollback mechanism โ€” revert production agent to previous version with validation (health check, smoke test)AWS AgentCore Runtime endpoint management โ€” DEFAULT alias for latest, named endpoints for environment pinningAgent evaluation gates โ€” block promotion to qa/prod if agent fails quality checks (PII safety, workflow accuracy)Agent version comparison โ€” run same evaluation suite against two agent versions to detect regressionPython automation for agent lifecycle operationsExperience: 4+ years platform or backend engineering with AI/ML systemsMulti-environment deployment and promotion workflowsRollback automation and safety validationQuality gate enforcement in deployment pipelinesNice to have: AWS AgentCore Evaluation API hands-on usageAgent regression testing and version comparisonBlue/green or canary deployment patterns for LLM agentsAgent health monitoring post-deployment Perks and Benefits: Flexible work schedule.Fixed financial bonus issued upfront on a quarterly basis, covering the average market price of private medical care and sport card - B2B contract.Present on the occasion of birthday, wedding, child birth.E-learning accounts for Coursera, O'Relly, Udemy.Corporate language school.