Summary
✨ AI‑Generated
A senior engineering role focused on designing and optimizing large-scale AI platforms. The position involves building production-grade AI systems, working with language models, data infrastructure, cloud environments, and scalable software solutions.
Highlights
Opportunity to build advanced AI infrastructure, work with modern generative AI technologies, and develop scalable production systems using cloud-native approaches.
Description
We are seeking a Senior AI Engineer to design, deploy and optimize cutting-edge AI infrastructure powering large-scale GenAI applications.
In this role, you will work with vector databases, LLM frameworks and cloud-native technologies to build robust, production-grade systems that drive intelligent solutions across the organization.
Responsibilities
Deploy and manage Milvus vector databases including schema design and index tuning with HNSW and IVF-FLATBuild embedding and LLM framework pipelines leveraging OpenAI API, Hugging Face or CohereManage Kubernetes clusters, Helm charts and containerized microservices for scalable orchestrationImplement Docker containerization with multi-stage builds and registry managementDevelop production-level applications in Python along with Go, Java or C++Integrate object storage systems including AWS S3, MinIO or Google Cloud StorageSupport large-scale RAG applications and multi-agent platformsOptimize compute and inference through GPU scheduling, resource optimization and inference accelerationDrive search optimization with hybrid search, metadata filtering and index tuningCollaborate effectively with the team to deliver high-quality solutions
Requirements
B.Tech/B.E in Engineering with 5+ years of relevant experienceExpertise in Milvus deployment, schema design and index tuning (HNSW, IVF-FLAT)Familiarity with Qdrant, Pinecone, Weaviate, PGVector or ChromaProficiency in OpenAI API, Hugging Face or Cohere for embeddings and LLMsSkills in Kubernetes cluster management, Helm charts and containerized microservicesCompetency in Docker containerization, multi-stage builds and registry managementProduction-level proficiency in Python along with Go, Java or C++Knowledge of object storage integration including AWS S3, MinIO or Google Cloud StorageExcellent verbal and written communication skills
Nice to have
Background in supporting large-scale RAG applications and multi-agent platformsFamiliarity with LangChain, LlamaIndex or custom LLM orchestration pipelinesUnderstanding of AI observability through LLM evaluation, governance, tracing and monitoring toolsKnowledge of CI/CD pipelines, Infrastructure-as-Code and cloud-native deployment practicesPrior work experience in the Oil and Gas industry along with Dataiku DSS and SRE practices
We offer
We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersWe cover it all:Monetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceDiscounts for fitness clubs and sports programsBenefits package (sports activities, a variety of stores and services)
EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups.
With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.
Experience the freedom of remote work from anywhere in Kyrgyzstan, whether it's the comfort of your home or our modern office in Bishkek.