Data Quality Developer

Silicon Luxembourg — Luxembourg · Posted ~21 hours ago

Senior

Skills

data quality management Apache Airflow Great Expectations database systems databases

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

An experienced developer role focused on implementing and industrializing a data quality management framework. The position involves automation, governance, database validation, and collaboration with data specialists.

Highlights

Opportunity to build automated data quality frameworks for critical information systems while working in a focused technical team.

Description

Talent Quanta TalentQuanta combines the agility of a boutique consultancy with the insight of a data-driven recruitment partner. Our approach blends deep sector knowledge with advanced research and network intelligence to deliver precise, high-impact results. THE MISSION On behalf of a confidential public sector institution in Luxembourg, we are looking for an experienced Data Quality Developer to join a small, focused team building a structured and sustainable data quality management framework. The institution manages several critical databases (case management, individuals, decisions, procedures, reference data, users, statistics) and wants to move from ad-hoc, partial data quality checks to a centralised, governed and automated control framework, built on Great Expectations and Apache Airflow. The Data Quality Developer will be responsible for the technical implementation and industrialisation of the platform, working in close collaboration with a Data Quality Analyst who defines and validates the underlying rules with the client’s data governance team. Key Responsibilities Install, configure and administer the Great Expectations platformConfigure connections to the client’s databases (PostgreSQL, DB2, and others as required)Develop the data quality rules validated by the client within Great ExpectationsDevelop custom Expectations where standard functionality does not cover a specific needOrganise controls into structured, maintainable Expectation SuitesImplement Checkpoints and validation mechanismsConfigure Data Docs and Great Expectations reportingDevelop automation workflows (DAGs) under Apache AirflowSchedule and automate the execution of quality controls according to defined frequenciesIntegrate controls into existing data pipelines where necessaryImplement logging, error handling and retry/recovery mechanismsDevelop notification and results-distribution mechanismsEnsure version control (Git) of all developmentsCarry out unit, integration and validation testing, and fix issues identified during UATDocument all technical developments and participate in knowledge transfer to the client’s internal teams EngREQUIRED SKILLS & EXPERIENCE Strong Python development skillsHands-on experience implementing and administering Great Expectations (Expectation Suites, Checkpoints, Data Docs, custom Expectations)Solid experience with Apache Airflow (DAG development, orchestration and automation)Experience with ETL/ELT processes and data integrationProficiency with Git version controlExperience writing unit, integration and validation testsStrong SQL skills and experience with relational databases (PostgreSQL, DB2)Experience building logging, monitoring and notification mechanismsStrong technical documentation skills NICE TO HAVE Experience with data governance platforms or data catalogue toolsExperience in IT system migration or modernisation projectsExposure to Master Data Management (MDM) implementationsExperience handling sensitive or confidential data, ideally in the public sectorKnowledge of BI/data architectures (Data Warehouse, Data Lake, ETL/ELT) Apply Now Skillbourg