Senior Data Software Engineer with AWS and Terraform

We are seeking a Senior Data Software Engineer to join a client-facing delivery team building and hardening cloud-native data pipelines on AWS as part of a data platform modernization program. The role involves ingesting and transforming large datasets with PySpark on AWS Glue and delivering curated, validated data into Snowflake, with a core focus on data quality, validation, and reconciliation for downstream analytics. This position is delivered at a Senior Consultant level with high autonomy and direct client stakeholder communication. Responsibilities Design, build, and optimize scalable batch and incremental ETL/ELT pipelines using PySpark on AWS GlueConfigure Glue jobs, crawlers, triggers, connections, bookmarks, workflows, and the Glue Data CatalogTune workers, partitioning, and shuffle behavior for cost and performance optimizationModel and load curated datasets into Snowflake with staging, transformation, and publishing layersImplement automated data quality and validation frameworks, including schema/contract enforcement and null/uniqueness/referential checksDevelop row-count and financial reconciliation processes, anomaly detection, and quarantine/reject handlingConfigure and extend Glue Data Quality (DQDL) rules per requirementsWrite clean, modular, testable Python with unit/integration tests and reusable librariesIntegrate pipelines with AWS services such as S3, IAM, Lambda, Athena, CloudWatch, Step Functions, and Secrets ManagerInstrument observability through logging, metrics, alerting, and pipeline SLA monitoringParticipate in code reviews, CI/CD automation, and documentationEngage directly with client stakeholders in requirements refinement, design walkthroughs, status reporting, and act as technical advisor within the workstream Requirements 3+ years of experience with Python for production-level data engineering, including OOP and functional patternsExpertise in PySpark for distributed data processing and the DataFrame APIAdvanced proficiency in Snowflake, including data warehousing and staging/transformation layersSkills in AWS Glue, including job configuration, crawlers, Data Catalog, and DQDLBackground in data quality engineering, including validation frameworks and reconciliationProficiency in AWS services including S3, IAM, Lambda, Athena, and CloudWatchEnglish proficiency at B2 level or higher Nice to have Familiarity with Generative AI / LLM conceptsKnowledge of Airflow / Step Functions orchestrationFamiliarity with Great Expectations or similar data quality frameworksKnowledge of Terraform / CloudFormation We offer We connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth:Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to EPAM's internal learning databaseFree English classes with certified teachersWe cover it all:Monetary bonuses for engaging in the referral programMedical & family care packageSix trust days per year (sick leave without a medical certificate)Coverage of psychology sessions of your choiceDiscounts for fitness clubs and sports programsBenefits package (sports activities, a variety of stores and services) EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments. Experience the freedom of remote work from anywhere in Kyrgyzstan, whether it's the comfort of your home or our modern office in Bishkek.