Senior Data Engineer

Join a large financial-services organisation and help develop a secure, scalable data platform used by teams across the business. As a Senior Data Engineer, you will design and optimise large-scale data pipelines in Azure Databricks while developing Python APIs and automation that make compliant data services easier to use. You will work within the record-keeping domain, where data quality, governance, security and reliability are essential. This role combines hands-on engineering with technical ownership. You will improve existing platform components, solve complex performance challenges and help define how reliable data solutions are delivered. You & Your Role Improve and build advanced data solutions that strengthen our clients data platform. As a Senior Data Engineer, you design and maintain scalable data pipelines in Azure Databricks and develop secure APIs that help platform users keep their data compliant. You collaborate closely with the record keeping team to ensure high?quality, reliable data services. Must Have Skills: 8+ years of experience designing and delivering production data solutions.Strong proficiency in Python with OOPS concepts and API KnowledgProficiency in PySpark and Databricks optimisation.Experience with Azure services such as Data Factory, Storage, SQL and DevOps.Analytical thinkingProblem solving mindsetAdaptability.Result oriented working style. Top 3 Responsibilities Lead the improvement of secure, scalable data service components by building and optimising high performance Databricks pipelines to process large-scale datasets and support compliant data use across the record keeping domain.Create automation and reliable data workflows by developing APIs and enhancing platform processes and ensure consistent delivery of compliant data to users.Collaborate with cross-functional teams to embed governance, quality, and performance standards by implementing secure, automated data workflows and strengthening end-to-end data solution integrity. About You: At least eight years of experience designing and delivering production data solutions.Strong Python development skills, including object-oriented programming.Experience designing, building or integrating APIs.Strong knowledge of PySpark and Azure Databricks.Practical experience optimising Databricks pipelines and workloads.Experience with Azure Data Factory, Azure Storage, Azure SQL and Azure DevOps.A solid understanding of data quality, governance and secure data processing.Strong analytical and problem-solving skills.The ability to adapt, take ownership and deliver results in a complex environment.Clear communication skills and experience collaborating across technical and business teams.. Why this role? You will work on a data platform that supports services used throughout a major financial organisation. Your work will directly improve how data is processed, governed and made available to users. The environment offers complex engineering challenges, large-scale datasets and a strong focus on automation, security and technical quality. You will also have room to develop your expertise while contributing to a platform with long-term organisational impact.