Data Engineer - Geospatial Data

Data Engineer – Demographic & Geospatial Data About the Role We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning. Key Responsibilities Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta LakeStandardise postcodes and enrich records using NHS and ONS postcode products and ODS reference dataImplement spatial joins and point-in-polygon matching, handling edge cases and multiple matchesVersion lookups and boundaries so historical outputs stay reproducibleAutomate data quality checks and reconcile counts before and after joinsOptimise Spark and spatial processing as data volumes growApply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in productionGeospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquetApache Sedona or native Databricks spatial functionsGit, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNsGeoPandas, Shapely or QGIS; regulated data environments