DontApply.Club
Login Register

AI AWS Data Engineer

Gazelle Global Consulting — United Kingdom · Posted ~4 hours ago

Mid

Skills

Python AWS data engineering API integration data pipelines event-driven architecture Lambda EventBridge SQS DynamoDB

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

An enterprise AI program is seeking a data engineer to create ingestion pipelines, connect source systems, and develop reliable cloud-based data workflows.

Highlights

Opportunity to build AI data platforms through modern cloud services, integration pipelines, and reliable data engineering practices.

Description

Join an enterprise-grade AI platform programme focused on securely and reliably bringing source-system data into a central platform for Generative AI and ML capabilities. This is an integration-focused Data Engineering role, building the connectors and ingestion pipelines that keep data flowing reliably across the CDS estate. You’ll develop event-driven ingestion patterns and onboard new source systems, working with APIs, webhooks and enterprise platforms. The role combines Python development with AWS services and data migration, with a strong focus on reliability, reconciliation, monitoring and error handling. Key responsibilities: Build source-system integrations using webhooks, REST APIs and event streams.Implement event-driven ingestion using API Gateway, Lambda, EventBridge and SQS.Develop DynamoDB-based state and watermark tracking with periodic reconciliation.Onboard new source systems such as Confluence and JIRA.Support data migration and backfilling activities using tools such as AWS DMS.Work with Knowledge Engineers to ensure data quality and structure for downstream use.Monitor integrations and implement effective error handling and alerting. Key Skills: PythonAWSAPI Gateway / LambdaEventBridge / SQSDynamoDBREST APIs and webhooksAWS DMSEvent-driven data engineeringData migration Experience with Apache Airflow, dbt, enterprise collaboration APIs and regulated environments would also be beneficial. For more information or to apply directly, please email Mir@gazellegc.com. I review applications daily and will contact shortlisted candidates as quickly as possible.