Senior Data Platform Engineer

Oec Solutions — Poland · Posted ~15 hours ago

Senior Full-time

Skills

AWS cloud-native architecture data engineering ETL serverless computing event-driven architecture data pipelines data contracts data governance data lineage observability serverless

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build the reusable cloud-native foundation that enables teams to ingest, transform, govern, access, and observe data at scale. As a Senior Data Platform Engineer, you’ll design serverless event-driven pipelines, standardize data contracts and configurations, and create self-service infrastructure that simplifies data engineering for other teams.

Highlights

Senior platform engineering role building reusable, self-service cloud data infrastructure with scalable serverless pipelines, standardized data contracts, governance, lineage, and observability.

Description

About the Role We’re looking for a Senior Data Platform Engineer to join the team building our cloud-native data infrastructure on AWS. You will be an active contributor to the design and evolution of a platform that serves both data producers and consumers, providing reusable, self-service capabilities for ingestion, curation, aggregation, governance, access interfaces, and observability. This is a platform engineering role: the solutions you build are generic, shared infrastructure, not one-off pipelines. Responsibilities Contribute to the design and implementation of reusable ETL pipeline templates, scalable, serverless, and event-driven for processing and transforming large datasets from diverse sourcesHelp build reusable, self-service platform components that abstract infrastructure complexity for data producers and consumers.Define and evolve standards of data contracts and pipeline configuration schemas that standardize how teams onboard to the platform.Implement data lineage tracking, and observability tooling to give producers and operators full visibility into platform health.Implement and maintain CI/CD pipelines and infrastructure as code using Terraform.Contribute to the technical direction of future platform capabilities, including streaming integrations, consumption interfaces, data democratization, and AI-assisted features such as failure remediation and automated contract suggestions. You Will Be a Great Fit If You… Have 5+ years of professional experience as a Data Engineer or Platform Engineer with strong focus on AWS servicesHave a proven track record of contributing to production-grade data platforms or complex data infrastructure.Understand data modeling and have a solid grasp of ETL best practices.Are proficient in Python for pipeline development, automation, and scripting.Are familiar with data ingestion mechanisms such as APIs, SFTP, or message queues.Have experience building event-driven architectures and scalable, cloud-native data pipelines.Have hands-on experience with streaming platforms such as Kafka or AWS Kinesis.Implement and maintain data quality rules using Soda Core, integrate quality check results with the DataZone catalog, and define the platform's approach to quality failure handling within the pipeline execution flow.Are comfortable building and managing infrastructure using Terraform.Use observability tools to monitor logs, performance, and system health.Can communicate technical concepts clearly and contribute to cross-team alignment. Tech Stack Cloud AWS: S3, Iceberg, DynamoDB, RDS, Glue, Athena, Lambda, Step Functions, EventBridge, Transfer Family, SageMaker, Lake Formation, DataZone, KMS, IAM Identity Center, SESLanguages: Python, SQLInfrastructure as Code: TerraformCI/CD: Jenkins, GitHub Actions Nice to Have Experience with Datadog for cloud observability and alerting.Familiarity with AI-assisted developer tools such as Claude Code or similar. If you have a passion for building robust, reusable data infrastructure and want to help shape a platform that will power data-driven products across the organization, we’d love to hear from you!