DontApply.Club
Login Register

Senior Data Engineer

Vistasglobal — Qatar · Posted ~4 hours ago

Senior

Skills

Google Cloud Platform Data engineering Batch and streaming data pipelines ETL/ELT BigQuery Dataflow Dataproc Pub/Sub Cloud Composer Cloud Storage SQL Data modeling Data quality Data governance CI/CD Git Automated testing Monitoring 8+ years of experience GCP

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A senior data engineering role focused on building scalable batch, near-real-time, and streaming pipelines in a modern cloud environment. You will design data platforms and models, implement data quality and governance controls, establish CI/CD and automated testing, optimize reliability and cost, and provide technical guidance to other engineers. Extensive professional experience in data engineering is required.

Highlights

Lead the design of scalable cloud data platforms and pipelines while working across modern data architecture, governance, observability, and performance optimization. The role includes technical leadership, mentoring, architecture reviews, and opportunities to use AI-assisted engineering tools.

Description

Key Responsibilities Design and develop scalable batch, near-real-time, and streaming data pipelines on GCP.Build and manage ETL/ELT pipelines and analytics-ready data products.Work with BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer, and Cloud Storage.Design modern Data Lake, Lakehouse, Data Warehouse, and Data Mesh solutions.Develop data models, dimensional models, transformations, and optimized SQL.Implement data quality, validation, reconciliation, observability, metadata, and lineage.Ensure data solutions meet security, privacy, governance, compliance, and performance standards.Implement CI/CD, Git, automated testing, monitoring, and production support.Optimize pipelines for performance, reliability, scalability, and cloud cost.Use approved AI-assisted engineering tools for development, testing, documentation, SQL optimization, and troubleshooting.Provide technical leadership, mentor engineers, and contribute to architecture/design reviews.Mandatory Skills 8+ years in Data Engineering / Data Architecture.Strong GCP experience.Strong Python and SQL.Hands-on ETL/ELT and data pipeline development.Experience with BigQuery + Dataflow / Dataproc / Pub/Sub / Cloud Composer.Strong data modelling / dimensional modelling experience.Knowledge of data governance, quality, lineage, and observability.Experience with Git, CI/CD, and automated testing.Strong understanding of modern cloud data architecture.