Summary
✨ AI‑Generated
A technology organization is seeking a hands-on data engineering leader to architect cloud data platforms, guide engineers, and build reliable data pipelines at scale.
Highlights
Lead a data engineering team while designing cloud data platforms and improving reliability and efficiency.
Description
About the Role
We are looking for a hands-on Data Engineering Lead to run a team of 10 engineers, both onshore and offshore, building cloud data platforms on Google Cloud.
This is a leadership role, not a senior individual contributor position.
You will set technical direction, review code, and make sure the team delivers reliable, cost-efficient data pipelines.
What You'll Do
Build pipelines: Design and improve ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub and Cloud FunctionsOwn the data platform: Architect and manage BigQuery, Cloud Storage and Data Fusion for ingesting, transforming and storing dataLead the team: Guide a team of 10 engineers, review code, and set standards for data engineering, CI/CD and monitoring (Cloud Monitoring, Logging)Tune performance and cost: Improve pipeline speed and query efficiency, and control GCP spend through practices like slot reservations and partitioningPartner across teams: Work with data architects, data scientists and analysts to deliver self-service data platforms and support advanced analytics and ML use casesProtect data quality: Put data validation, lineage and metadata management in place using tools such as Data Catalog and dbt
Required Skills
Leadership: Proven experience leading data engineering teams across onshore and offshore locations.
Candidates without team leadership experience will not be considered.Core technical skills: SQL, Python, Java or Scala, and distributed systems such as Spark and BeamGCP expertise: Hands-on work with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow) and TerraformDevOps: Familiarity with CI/CD, Git and infrastructure as code
Nice to Have
GCP certification, such as Professional Data EngineerExperience with real-time processing, Vertex AI or multi-cloud environments