Data Engineer Level I

DWP. Digital with Purpose We need a Data Engineer to join our Debt Solutions team and help shape the future of data at DWP. You'll need experience of SQL-based data transformation, ETL pipeline development, and building user-facing dashboards and reports Our DWP Digital teams use fresh ideas and leading-edge tech to build and maintain digital solutions that will be used by nearly every person in the UK, every day and at key moments in their lives. DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support and empower millions of people. The scale of what we do is extraordinary, and our purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments.Knowledge of AWS Lambda and event-driven solutions to support automated data processing.Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.Ability to optimise data processing, storage, and queries to improve performance and data quality.Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role As a Data Engineer in DWP Digital, you'll design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions. Working as part of a multidisciplinary agile team, you'll help transform critical business data into trusted insights, supporting systems that recover around £3 billion of debt annually while protecting vulnerable citizens You will develop and operate ETL pipelines in cloud-based environments, integrating data from a variety of source systems and transforming it into meaningful, trusted information. Using SQL and modern data engineering practices, you'll create reusable, production-ready solutions that enable colleagues and stakeholders to gain valuable insights from data. Working with senior colleagues, you'll help develop user-facing dashboards and reports that provide accessible, accurate information to customers and stakeholders. This is an excellent opportunity to join a team modernising long-established MI and data services through a new cloud-powered platform. You'll also be part of a collaborative data community, and work with experienced colleagues to share expertise and contribute to innovative solutions that deliver impact at national scale. Details. Wages. Perks. Hybrid Working: We work a hybrid model - you'll spend some time working at home (40%) and some time collaborating face to face in a hub (60%). Pay: We offer competitive pay for this role of £38,772. Pension: You'll get a brilliant civil service pension with employer contributions of 28.97%, worth over £11,232 per year. Holidays: A generous leave package starting at 24 days rising to 26 days after one year (and 31 days over time). You can also take up to 3 extra days off a month on flexi-time. You'll also get all the usual public holidays. We have a broad benefits package built around your work-life balance which includes: Time off volunteering and charitable givingDiscounts and savings on shopping, fun days out and moreInterest-free loans to buy a bike or a season ticketProfessional development, coaching, mentoring and career progression opportunities. And we have an award-winning environment and culture: DWP have been recognised as 2024 Diversity Employer of the Year at the Computing Women in Tech Excellence awardsDiverse and Inclusive Leadership at Digital Leaders Awards 2024Best Place to Work in Digital category in the Computing Digital Technology Leaders awards 2025Recognised as one of the Best Public Sector Employers at 2025 Women In Tech Employer Awards Process: We know your time is valuable, so our application and selection process is just two stages: Apply: complete your application on Civil Service Jobs.Interview: A single stage interview online. CLICK APPLY for more information and to start your application