Senior AWS Data Engineer

Lancesoft — Canada · Posted ~1 day ago

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Description

Pay Range: CAD 50-55/hr Netezza Experience is Mandatory Key Responsibilities • Design, develop, maintain and support scalable data pipelines using ETL tools and AWS technologies • Lead and support data platform migration initiatives (On-Prem to AWS Cloud) • Develop and manage ETL/ELT processes using tools like SSIS or similar • Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow • Build and optimize data workflows and orchestration pipelines using Airflow • Experience with CICD pipeline using Python, Git. • Perform data ingestion, transformation, and validation from multiple data sources • Optimize SQL queries for performance and scalability • Monitor system performance, troubleshoot issues, and ensure system reliability • Collaborate with cross-functional teams including developers, architects, and infrastructure teams Required Technical Skills Cloud Technologies • Strong experience in AWS Cloud services: o EMR, EC2, S3, VPC, RDS, Redshift o AWS Glue, IAM, CloudWatch, CloudFormation o Airflow (or AWS Managed Workflows) Databases • Experience working with: o Working on Netezza o SQL-based systems: SQL Server and PostgreSQL o Data warehouses: Netezza , Redshift ETL Tools • Hands-on experience with: o In any ETL tools (like SSIS, Datastage, informatica etc) Programming & Scripting • Strong proficiency in: o SQL o Shell scripting • Good to have: o Python Operating Systems • Strong experience in Unix/Linux environments Key Qualifications • 10+ years of experience in Data Engineering / AWS / Platform Engineering • Hands-on experience in ETL tools and AWS • Experience in data migration projects • Strong understanding of data warehousing concepts and ETL design patterns • Expertise in query optimization and performance tuning • Experience supporting production data platforms • Bachelor’s degree in Computer Science, Engineering, or related field Preferred Qualifications • Experience in Banking / Financial Services domain • Experience with data lake architecture and governance • Knowledge of DevOps tools and CI/CD pipelines • Experience in platform engineering and framework development Soft Skills • Excellent problem-solving and analytical skills • Strong communication and collaboration abilities • Ability to work independently and lead initiatives • Experience mentoring team members Nice to Have • Experience with tools like Ansible, Git, JIRA • Exposure to NoSQL databases (HBase, MongoDB) • Experience in data masking and security frameworks