Senior Platform Engineer

JOB Description: Job Summary We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment. Key Responsibilities Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologiesLead and support data platform migration initiatives (On-Prem to AWS Cloud)Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similarImplement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and AirflowBuild and optimize data workflows and orchestration pipelines using AirflowWork with real-time streaming technologies such as Kafka and Spark StreamingPerform data ingestion, transformation, and validation from multiple data sourcesOptimize SQL queries for performance and scalabilityMonitor system performance, troubleshoot issues, and ensure system reliabilityCollaborate with cross-functional teams including developers, architects, and infrastructure teamsRequired Technical Skills Cloud Technologies Strong experience in AWS Cloud services: EMR, EC2, S3, VPC, RDS, RedshiftAWS Glue, IAM, CloudWatch, CloudFormationAirflow (or AWS Managed Workflows)Databases Experience working with: SQL-based systems: SQL Server and PostgreSQLData warehouses: Teradata, Redshift, NetezzaETL Tools Hands-on experience with: SSISProgramming & Scripting Strong proficiency in: SQLShell scriptingGood to have: PythonOperating Systems Strong experience in Unix/Linux environmentsKey Qualifications 10+ years of experience in Data Engineering / Big Data / Platform EngineeringHands-on experience in AWS and Hadoop ecosystemsExperience in data migration projects (e.g., Hadoop to AWS, DB migrations)Strong understanding of data warehousing concepts and ETL design patternsExpertise in query optimization and performance tuningExperience supporting production data platformsBachelor’s degree in Computer Science, Engineering, or related fieldPreferred Qualifications Experience in Banking / Financial Services domainExperience with data lake architecture and governanceKnowledge of DevOps tools and CI/CD pipelinesExperience in platform engineering and framework developmentSoft Skills Excellent problem-solving and analytical skillsStrong communication and collaboration abilitiesAbility to work independently and lead initiativesExperience mentoring team membersNice to Have Experience with tools like Ansible, Git, JIRAExposure to NoSQL databases (HBase, MongoDB)Experience in data masking and security frameworks