Summary
✨ AI‑Generated
We are seeking a Senior Data Engineer to design and build scalable data platforms, implement data pipelines, and manage metadata and data quality. The role involves using Python, Snowflake, AWS, and other tools to create reliable analytical systems. You will collaborate with business and technology teams to align data solutions with organizational goals.
Highlights
Work on cutting-edge data platforms, use Python, Snowflake, and AWS to build robust data pipelines, and collaborate with business teams in a hybrid environment.
Description
Job Title: Senior Data Engineer
Job Location :London, UK ( 2 days a week in client office, 3 days remote)
Job Type :Permanent, Contract, FTC
Job Description:
Mandatory Skillsets: Python, Snowflake, dBT, dremio, glue jobs, Apache iceberg, AWS ,SQL
Key Responsibilities:
• Architect and Develop: Contribute to the platform’s architectural design and build integration, modelling, data persistence, and analytical systems.
• Data Pipelines: Implement, maintain, and test robust data pipelines.
• Metadata Management: Develop and manage metadata processes and tools.
• Performance Monitoring: Ensure the stability and performance of data pipelines.
• Data Quality: Implement tools for data curation, metadata management, and quality assurance.
• Collaboration: Engage with business and technology teams to align the platform with organizational goals.
Preferred Technical Skills:
• Programming: 5+ years of experience in Python/Java.
• Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).
• Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.
• Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.
• Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.
• Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.
• RDBMS: Knowledge of PostgreSQL is a plus.
• Industry Experience: Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.
