Senior AI Engineer

We are seeking a Senior AI Engineer to design, deploy and optimize cutting-edge AI infrastructure powering large-scale GenAI applications. In this role, you will work with vector databases, LLM frameworks and cloud-native technologies to build robust, production-grade systems that drive intelligent solutions across the organization. Unlock the potential of remote work in Kazakhstan, giving you the flexibility to work from home or access our offices in Astana, Almaty or Karaganda. Responsibilities Deploy and manage Milvus vector databases including schema design and index tuning with HNSW and IVF-FLATBuild embedding and LLM framework pipelines leveraging OpenAI API, Hugging Face or CohereManage Kubernetes clusters, Helm charts and containerized microservices for scalable orchestrationImplement Docker containerization with multi-stage builds and registry managementDevelop production-level applications in Python along with Go, Java or C++Integrate object storage systems including AWS S3, MinIO or Google Cloud StorageSupport large-scale RAG applications and multi-agent platformsOptimize compute and inference through GPU scheduling, resource optimization and inference accelerationDrive search optimization with hybrid search, metadata filtering and index tuningCollaborate effectively with the team to deliver high-quality solutions Requirements B.Tech/B.E in Engineering with 5+ years of relevant experienceExpertise in Milvus deployment, schema design and index tuning (HNSW, IVF-FLAT)Familiarity with Qdrant, Pinecone, Weaviate, PGVector or ChromaProficiency in OpenAI API, Hugging Face or Cohere for embeddings and LLMsSkills in Kubernetes cluster management, Helm charts and containerized microservicesCompetency in Docker containerization, multi-stage builds and registry managementProduction-level proficiency in Python along with Go, Java or C++Knowledge of object storage integration including AWS S3, MinIO or Google Cloud StorageExcellent verbal and written communication skills Nice to have Background in supporting large-scale RAG applications and multi-agent platformsFamiliarity with LangChain, LlamaIndex or custom LLM orchestration pipelinesUnderstanding of AI observability through LLM evaluation, governance, tracing and monitoring toolsKnowledge of CI/CD pipelines, Infrastructure-as-Code and cloud-native deployment practicesPrior work experience in the Oil and Gas industry along with Dataiku DSS and SRE practices We offer We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersDiscounts in local language schools, including online courses for the Kazakh languageWe cover it all:Participation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceBenefits package (sports activities, a variety of stores and services)Housing support program: preferential mortgage access via Otbasy Bank partnership EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.