Data Engineer

Infinityquest โ€” United Kingdom ยท Posted ~2 days ago

Skills

ETL Data ingestion ETL development Java Python CSV JSON XML Parquet Avro Databricks Apache Flink Batch processing Stream processing

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Summary

Join a data engineering team as a Data Engineer focused on end-to-end data ingestion and ETL development. You will work with Java and/or Python, ingest data from diverse source systems and formats, and use Databricks and Apache Flink for transformation and both batch and streaming data processing.

Highlights

Strong data engineering role centered on end-to-end ingestion and ETL development. The position provides hands-on exposure to Databricks, Apache Flink, multiple structured and semi-structured data formats, and both batch and streaming data processing.

Description

Resource Requirement โ€“ Developer with ETL Experience We are looking for a Developer with ETL experience with strong experience in data ingestion and ETL development. Required Skills: Hands-on experience in ETL - end-to-end data ingestion.Strong programming skills in Java and/or Python.Experience working with various file formats (CSV, JSON, XML, Parquet, Avro, etc.) and ingesting data from multiple source systems.Hands-on experience with Databricks for data processing and transformation.Experience with the Apache Flink framework for stream and batch data processing