Senior Data Engineer – Databricks Migration & Modernization

Sr2 Socially Responsible Recruitment — Netherlands · Posted ~2 hours ago

Senior Full-time Hybrid

Skills

data engineering Databricks Apache Spark Python Scala SQL dbt data pipeline migration Lakehouse architecture Medallion architecture

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Join a major enterprise data transformation program as a Senior Data Engineer focused on migrating and modernizing complex data workloads. You will refactor legacy pipelines and data products, build production-grade Lakehouse solutions with modern data technologies, and create reusable frameworks that accelerate migration across multiple teams.

Highlights

Work on a major enterprise data transformation program with hands-on engineering, technical consulting, modern Lakehouse architecture, and the opportunity to build reusable migration frameworks and accelerators.

Description

Senior Data Engineer – Databricks Migration & Modernisation The Hague, Netherlands – 3 days onsite per week Up to €100,000 Permanent We’re looking for an experienced Senior Data Engineer / Migration & Modernisation Engineer to join a major enterprise data transformation programme in The Hague. You’ll be working on the modernisation and consolidation of complex data workloads onto a next-generation Databricks Lakehouse platform. This isn't simply a BAU data engineering position. You'll combine hands-on engineering with technical consulting, while developing reusable migration frameworks and accelerators that enable multiple teams to modernise their data estate faster and more consistently. What you'll be doing Refactoring legacy data pipelines, models and data products into scalable Lakehouse and Medallion architecturesBuilding production-ready pipelines using Databricks, Spark, Python/Scala, SQL and DBTDeveloping reusable migration accelerators, utilities, templates and reference implementationsAssessing existing pipelines and recommending practical migration and refactoring approachesEstablishing engineering patterns, standards and best practicesSupporting data validation, reconciliation, testing and performance optimisationWorking directly with engineering teams, architects and business stakeholdersRunning technical workshops and design reviewsApplying GenAI and agentic AI to accelerate migration, code conversion, documentation and engineering workflows We are looking for strong experience across: Databricks | Apache Spark | Python | SQL | Delta Lake | Unity Catalog | DBT | Lakehouse | Medallion Architecture | ETL/ELT You'll ideally have: Delivered complex data migration or modernisation programmesStrong hands-on Databricks and Spark engineering experienceExperience modernising legacy ETL/ELT workloadsBuilt reusable frameworks, libraries, tooling or engineering patternsStrong data modelling and data-quality experienceExperience with CI/CD and modern DevOps practicesThe communication skills to advise and challenge technical stakeholdersAn interest in using GenAI/AI agents within data engineering The role specifically requires someone capable of operating as both a hands-on engineer and technical consultant to migration teams. This is an opportunity to play an influential role within a significant enterprise data-platform modernisation programme, helping establish how migrations are engineered and delivered at scale rather than simply migrating individual pipelines.