Summary
✨ AI‑Generated
A major infrastructure-focused organization is seeking a Lead Data Engineer to take technical ownership of modern, scalable data platforms supporting near-real-time environmental monitoring. You will design, build, and optimise batch and streaming pipelines using Databricks, Spark, and Delta Lake, while applying a structured medallion architecture and strong data governance practices. The role is hybrid, with regular onsite collaboration, and offers the opportunity to work on a high-impact programme where data quality and timeliness directly support scientific, regulatory, and operational decisions.
Highlights
Take technical ownership of modern, scalable data platforms in a high-impact environmental programme. The role offers substantial responsibility for designing reliable data pipelines, working with complex telemetry and environmental datasets, and delivering trusted insights to technical and operational stakeholders.
Description
About Us
Lead Data Engineer (Databricks)
River Water Quality Programme
Warrington (Hybrid – 3 days onsite per week)
At United Utilities, we’re committed to protecting the environment that millions of people depend on every day.
As part of our Digital Services team, you’ll play a pivotal role in one of our most important and high-impact initiatives: near real time monitoring of river water quality.
We’re looking for a Lead Data Engineer to take technical ownership of modern, scalable data platforms that turn complex environmental and telemetry data into trusted insights for regulators, scientists, and operational teams.
What You’ll Be Doing
As the Lead Data Engineer on our River Water Quality Programme, you’ll design, build, and optimise Databricks-based data pipelines that enable timely, reliable and well-governed data across the organisation.
You’ll:
Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta LakeImplement medallion architecture (bronze/silver/gold) to ensure data quality, lineage and efficient consumptionOptimise Spark jobs and workflows to meet near real-time monitoring SLAsBuild and maintain streaming pipelines using Structured Streaming and Delta Live TablesEnsure strong data governance, including schema enforcement, validation rules and ACID complianceOrchestrate and automate pipelines using Databricks Jobs, APIs or cloud-native schedulersCollaborate with data scientists, analysts and environmental specialists to deliver high-quality, well-documented datasetsMonitor, troubleshoot and continuously improve production pipelines for reliability, performance and cost efficiencyChampion best practices across CI/CD, testing, version control and documentation
Act as a technical leader and mentor, raising standards across the data engineering community
Essential
What you’ll bring
Deep expertise in Databricks (Spark / PySpark, Delta Lake, Unity Catalog, Workflows)Strong experience building ETL/ELT pipelines, both batch and streamingAdvanced Python and SQL skillsHands-on experience with cloud platforms (Azure, AWS or GCP)Solid understanding of data modelling and modern architecturesStrong knowledge of data governance, security and compliance
Desirable
Experience with orchestration tools such as AirflowFamiliarity with CI/CD pipelines, Git workflows and automated testingExposure to real-time, IoT or environmental telemetry data
Experience & Qualifications
Bachelor’s degree in Computer Science, Data Engineering or a related discipline5+ years’ experience in data engineering roles, including 3+ years with Databricks
Proven ability to lead technically and mentor engineers
What You’ll Get
We believe in rewarding our people properly:
Up to 10.5% annual bonusOutstanding pension – up to 21% combined contributionPrivate healthcareShare buy schemeWellbeing benefits and support programmes
Other
Why United Utilities?
You’ll be working on data that truly matters — protecting rivers, supporting environmental compliance, and helping shape the future of sustainable water management across the North West.
If you’re passionate about modern data engineering, enjoy technical leadership, and want your work to have real-world environmental impact, we’d love to hear from you.
