Lead Python Data Engineer

Epam Systems — Kazakhstan · Posted ~3 hours ago

Lead Full-time Remote

Skills

Python Data pipelines ETL ELT Apache Airflow Apache Spark Airflow Spark

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A lead data engineering role focused on designing Python-based pipelines, improving data quality, building processing workflows, and optimizing data systems.

Highlights

Flexible remote role focused on advanced data engineering, pipeline development, optimization, and large-scale data processing.

Description

We seek a skilled Lead Python Data Engineer to join our team and help us build and maintain our data pipelines. As a Python Data Engineer, you will be responsible for designing, developing, and testing Python-based data pipelines and performing data cleansing, transformation and quality assurance. Unlock the potential of remote work in Kazakhstan, giving you the flexibility to work from home or access our offices in Astana, Almaty or Karaganda. Responsibilities Design, develop, test and maintain Python-based data pipelinesWrite high-quality and maintainable Python code to migrate data between different storage systems with modificationsCreate ETL jobs, airflow operators, and Spark jobs to enhance data processing capabilitiesImplement Data Intake processes for Data Sources (ETL/ELT, DWH Modelling and Optimization)Perform data cleansing, transformation and quality assurance to maintain data integrityOptimize data processing, storage and retrieval to improve performanceCollaborate closely with cross-functional teams to ensure data accuracy and consistency Requirements In-depth learning of Python programming with the ability to write maintainable and scalable codeStrong understanding of distributed computation and multiprocessingKnowledge of data warehouse concepts and ETL processesProficiency in working state machines, web back-end development, networking and protocolsExperience with cloud computing platforms, such as AWS or GCP, and tools like Step Functions, BatchKnowledge of Spark, Hive, Databricks and other data processing frameworksFamiliarity with data orchestration tools like AirflowExpertise in with SQL, NoSQL and cloud-based data storage solutions We offer We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersDiscounts in local language schools, including online courses for the Kazakh languageWe cover it all:Participation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceBenefits package (sports activities, a variety of stores and services)Housing support program: preferential mortgage access via Otbasy Bank partnership EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.