Data Software Engineer

Epam Systems — Kazakhstan · Posted ~2 hours ago

Full-time Hybrid

Skills

Python data engineering software engineering SDK development data pipelines Databricks Delta Lake Azure Data Lake SAP HANA Data Lake SDK

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build reusable Python libraries and SDK modules that enable data engineering teams to create, test, deploy, and monitor pipelines efficiently. You will design scalable frameworks, improve data quality and lifecycle operations, gather feedback from internal users, and support a large portfolio of data pipelines. The role offers remote work flexibility with optional office access.

Highlights

Remote-friendly role in Kazakhstan building reusable data engineering libraries and SDKs that support scalable, reliable data pipelines across diverse data domains.

Description

We are looking for a Data Software Engineer to help build a scalable solution used by data engineers to build, test, deploy and monitor data pipelines. You will develop reusable libraries and SDK modules that enable teams to ship data products autonomously and efficiently, working with Databricks, Delta Lake, Azure Data Lake and SAP HANA Data Lake. Unlock the potential of remote work in Kazakhstan, giving you the flexibility to work from home or access our offices in Astana, Almaty or Karaganda. Responsibilities Develop and maintain reusable SDK modules (Python) for data pipeline operations such as compaction, quality checking, schema evolution and table lifecycle managementDesign and build framework libraries following software engineering best practices, ensuring scalability and reliability across 100+ pipelines and diverse data domainsCollaborate with Data Engineers who consume the framework to gather feedback, understand pain points and iterate on the SDKContribute to platform architecture discussions and performance tuning strategiesWrite high-quality documentation and contribute to enablement materials for framework consumersHelp define and infuse data engineering best practices through enablement, SDKs and templatesEnsure data quality, consistency and governance across Lakehouse environments Requirements Strong experience as a Data Engineer with proficiency in Databricks3+ years of experience building reusable libraries, SDKs or internal developer toolingKnowledge of Data Mesh/Data Product concepts including data ownership, domain-oriented design and self-serve data platformsDeep expertise in Delta Lake, Delta tables and compaction with optimization for high-performance workloadsProven experience designing and maintaining complex data pipelines on cloud object stores (ADLS, etc.)Strong programming skills in Python for data engineering workloadsSolid understanding of Lakehouse architecture and best practices for large-scale data platformsHands-on experience with data pipeline monitoring, troubleshooting and performance tuningFamiliarity with CI/CD and workflow orchestration (Databricks Jobs)Experience working in agile teams with a focus on ownership, autonomy and best practicesExcellent problem-solving skills and capability to handle high-scale, complex data challengesEnglish proficiency at B2 level or higher Nice to have Experience with agile methodologies (Scrum, SAFe)Experience developing enablement materials and technical documentation We offer We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersDiscounts in local language schools, including online courses for the Kazakh languageWe cover it all:Participation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceBenefits package (sports activities, a variety of stores and services)Housing support program: preferential mortgage access via Otbasy Bank partnership EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.