Lead Data Software Engineer

We are seeking a Lead Data Software Engineer with Databricks expertise to drive the technical design, robustness, and evolution of end-to-end traceability solutions, enabling transparency, regulatory compliance, and data-driven decision-making across the supply chain. This role provides technical leadership and architectural direction for traceability platforms and data products, working with heterogeneous datasets ranging from farm and geolocation data to transactional, logistics, sustainability, and regulatory information. The successful candidate will collaborate closely with the Traceability solution team, sustainability experts, business analysts, data engineers, and data scientists, acting as a technical reference to ensure traceability data pipelines, data models, and platforms remain aligned with best practices and long-term architectural vision. Responsibilities Provide technical leadership and ownership for traceability data platforms, pipelines, and data productsDefine, document, and enforce architectural principles, technical standards, and best practices for traceability solutionsOversee the design of robust pipelines, quality controls, and proactive monitoring frameworks to ensure data availability, quality, integrity, and timelinessGuide and support data engineers and technical contributors on implementation choices, troubleshooting, performance optimization, and best practicesContribute strategically to Run execution and continuous improvement, including data quality, lineage, auditability, and operational monitoringTranslate traceability and regulatory requirements into technical solutions, data models, and platform capabilitiesCollaborate closely with solution architects, data platform teams, and external partners to ensure alignment and scalabilitySupport adoption of traceability solutions by business and sustainability teams through technical guidance and enablement Requirements 5+ years of experience in technical roles within data, analytics, or platform environments, with exposure to leadership or solution ownership responsibilitiesExpertise in cloud-based data platforms, preferably AzureBackground in data architecture, data modeling, and data platform design, including complex, large-scale datasetsHands-on experience with Databricks, Spark/PySpark, and SQL for data transformation pipelines and analytics platformsProficiency in SQL and data storage concepts, including relational databases, NoSQL, and data lakes, with performance optimization for large and complex datasetsKnowledge of Python and data manipulation ecosystems such as Pandas and NumPy, with ability to review and guide code even if not hands-on full timeFamiliarity with data visualization tools including Power BI, Tableau, and LookerExperience designing or governing data quality frameworks, lineage, monitoring, and auditabilityFamiliarity with orchestration tools and data integration patterns such as ADF, Airflow, and AWS Glue, or equivalentExperience with software engineering best practices including version control with git, branching strategies, code reviews, and CI/CDUnderstanding of data governance, security, and access control for sensitive business and regulatory dataProficiency in English at a B2+ level We offer We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersWe cover it all:Monetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceDiscounts for fitness clubs and sports programsBenefits package (sports activities, a variety of stores and services) Experience the freedom of remote work from anywhere in Kyrgyzstan, whether it's the comfort of your home or our modern office in Bishkek. EPAM Kyrgyzstan is a team of technologists and innovators united by a passion for technology. In 2022, we opened our first office in Bishkek that works with the world's leading companies across many different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, client collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities.