Data Engineer

Cognifysearch — United Kingdom · Posted ~3 hours ago

Mid Full-time

Skills

Python PySpark SQL Azure Databricks Azure Data Factory Microsoft Fabric Microsoft Purview data pipelines data modeling

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A data engineering role focused on designing scalable cloud data solutions, building robust pipelines, and improving enterprise data platforms. The position requires strong programming skills and experience with modern analytics technologies.

Highlights

Opportunity to work on large-scale data platforms using modern cloud technologies and collaborate with experienced engineering and architecture teams.

Description

We’re currently looking for an experienced UK-based Data Engineer to join a major UK Public Sector data project, supporting the development and delivery of modern data platforms and scalable data solutions. You’ll work closely with Data Architects, Analysts, Engineers and wider delivery teams to build robust data pipelines, develop data models and implement integration patterns aligned to a new Target Operating Model for Data. This is a hands-on engineering role suited to someone who enjoys building, improving and optimising modern cloud data platforms. What we are looking for: Strong commercial experience as a Data Engineer.Strong Python, PySpark and SQL skills.Hands-on experience with Azure Databricks.Strong knowledge of Azure Data Factory and Microsoft Fabric.Experience with Microsoft Purview.Experience with event-driven data ingestion, such as Event Grid / Pub-Sub.Understanding of SOLID principles, asynchronous programming and design patterns such as Mediator and Factory.Experience implementing unit and integration testing within Databricks.Understanding of secure ETL design, including Entra ID / SCIM integration.Knowledge of Azure best practices, API Management (APIM) and platform governance.Experience building data models for Power BI using Databricks data sources. Contract: Freelance / Contract Location: Remote – UK-based candidates Start: ASAP Clearance: Candidates must be eligible for UK Security Clearance (SC) or already hold active SC.