Senior Data Engineer

Insight International Uk Ltd — Netherlands · Posted ~3 hours ago

Senior Full-time

Skills

Python SQL PySpark Apache Spark ETL data pipelines cloud platforms Spark Airflow BigQuery dbt

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A technology team is hiring a senior data engineer to build scalable pipelines, manage cloud data platforms, and develop reliable analytics infrastructure.

Highlights

Opportunity to design production-grade data platforms, work with modern cloud technologies, and solve complex data engineering problems.

Description

Role: Senior Data Engineer Location: Amsterdam, Netherlands Duration: Permanent Technical skills we are looking for: - At least 8 years of relevant experience in data engineering, cloud engineering, data analytics or a closely related technical field. - Proven hands-on experience designing and building complex production-grade data pipelines using ETL and ETL patterns. - Strong programming skills in Python and SQL, with practical experience using PySpark for distributed data processing. - Hands-on experience with Apache Spark and workflow orchestration tools such as Apache Airflow. - Experience with cloud data platforms, preferably Google Cloud Platform and BigQuery, and working knowledge of Azure or AWS. - Strong understanding of data modelling, normalization and denormalization, data integration, data lakes and data warehouses. - Experience with relational and non-relational data stores, including technologies such as MS SQL, Hive and dbt, plus object storage such as Amazon S3. - Experience with containerization, orchestration and automated delivery tooling, including Docker, Kubernetes and CI/CD pipelines. - Experience managing and optimizing distributed systems and clusters for large-scale batch processing. - Good command of software engineering practices, including modular design, testing, code review, documentation, security and production support. Soft skills we are looking for: - Curious mindset; you are collaborative and passionate about helping others to grow and improve, - Proactive, hands on - can-do mentality, on top of your delivery (no surprises) and positive mind-set - The ability to facilitate decision-making to drive complex design issues to a conclusion. - Team player with good communication skills (Fluent in English) and experienced in working in an international environment. - Strong organisational sensitivity: ability to understand and consider the underlying issues, opportunities and dynamics of an international organisation with multiple functional and hierarchical lines, dealing with multiple (sometimes conflicting) interests. - A strong resilience: the ability to navigate through ambiguity and simplify complexity without losing essence. - Excellent communication skills, including being able to explain technical terms to non-technical audience Competencies and experience: - Minimum of 8 years working experience in the technical data or cloud role - At least 8 years of proven track record in delivering Data, BI or IT solutions, preferably with an Agile Way of Working - Strong understanding of the main building blocks of data pipelines, ETL/ELT processes, and managing data lakes and warehouses - Experience in data modeling, normalization/denormalization, and integrating data across complex systems - Prior experience in Python, SQL, PySpark, dbt Labs for data processing and automation. - Good to have: Understanding of Financial Markets and Group Treasury business, FM/GT related products, KYC, FM regulations (EMIR, MIFID, SFTR, AFSL, MAS etc) and financial institutions (brokers, CCP’s, venues etc.)