Senior Golang Software Engineer

We are looking for a Senior Software Engineer to join a team building a comprehensive platform designed to evaluate Large Language Model performance and provide inference endpoints for Generative AI applications at enterprise scale. The platform enables stakeholders to systematically assess, compare, and select the most suitable LLMs for use cases, including natural language processing, customer service automation, content generation, and data analysis. It routes, secures, and governs LLM inference across multiple model providers. In this role, you will design and build scalable, production-ready backend systems using Go in a microservices architecture. You will own critical backend services, integrate with external LLM providers, and ensure reliability, performance, and security at scale. The project is in its initial strategic phase — defining personas, mapping user journeys, designing UX, and establishing a development roadmap with epics and user stories to guide future investment. This is a high-impact engineering role requiring independent execution, technical leadership, and cross-functional collaboration in ambiguous problem spaces. Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi. Responsibilities Design and implement production-grade backend features using Go in a microservices-style architectureBuild and maintain provider integration frameworks for external LLM vendors (OpenAI, Anthropic, cloud AI services)Own backend service quality through robust unit and integration testing; continuously improve CI/CD quality gatesImprove data access reliability and performance across PostgreSQL and RedisCollaborate cross-functionally on architecture, scalability, security, and operational excellenceLead technical design discussions and deliver solutions independently end-to-endWork with product teams on API requirements, troubleshoot issues, and identify new requirementsContribute to platform roadmap through technical input on feasibility, trade-offs, and system design Requirements 7+ years of professional software engineering experience with strong backend ownershipDeep expertise in Go, including idiomatic design, interfaces, concurrency, context management, and error handlingHands-on experience building HTTP APIs, middleware, and service-oriented architecturesStrong experience with PostgreSQL — schema design, query optimization, and database migration workflowsPractical experience with Redis — caching strategies, counters, and distributed rate-limiting patternsExperience designing or working with authorization and policy systems (RBAC/ABAC concepts)Strong testing discipline in Go (table-driven tests, mocks, integration tests, and test containers)Experience operating production systems with observability tooling (OpenTelemetry metrics and tracing, dashboards, and alerting)Solid experience with Kubernetes and Helm deploymentsStrong CI/CD experience (GitHub Actions or equivalent)Demonstrated ability to lead technical design and execute independentlyFamiliarity with GenAI concepts and OpenAI APIs, with a drive for self-learningFamiliarity with AI-assisted development while maintaining strong quality and architectural standardsGood communication and collaboration skillsB2+ English level (written and verbal) Nice to have Experience building LLM gateways, API gateways, or multi-provider AI/ML integration platformsExperience with gRPC, cloud SDKs, or service integrations on AWS, Azure, or GCPFamiliarity with API platform security controls — API keys, OIDC, secrets management, and abuse preventionExposure to cost and performance optimization for high-volume inference or request-processing workloadsExperience contributing to platform roadmap planning (epics, user stories, backlog prioritization)Background working with UX/product teams during early-stage platform definition We offer We connect like-minded peopleDelivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growthLeadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersWe cover it allParticipation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programComprehensive medical & family care packageFive trust days per year (sick leave without a medical certificate)Benefits package (sports activities, a variety of stores and services) EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.