Summary
✨ AI‑Generated
An experienced data architecture opportunity focused on designing large-scale cloud data platforms. You will architect Snowflake solutions on AWS, orchestrate ingestion and transformation pipelines, apply lakehouse and medallion patterns, automate transformations, and optimize data environments for performance, cost, and scalability.
Highlights
Architecture-focused data engineering role involving large-scale transformation programs, modern AWS and Snowflake platforms, automated data pipelines, lakehouse architecture, and performance, cost, and scalability optimization.
Description
Experience and Capabilities:
· Extensive experience ( 8 + years) in data architecture and engineering, with a proven track record in large - scale
· data transformation programs, ideally in insurance or financial services.
· Proven experience in architecti ng and implementing advanced data solutions using Snowflake on AWS,
· Expertise in d esign and orchestrati ng data acquisition pipelines using AWS Glue for ETL/ELT , Snowflake
· OpenFlow and Apache Airflow for workflow automation, enabling seamless ingestion of different data from
· diverse sources.
· Proven experience in DBT to manage and automate complex data transformations within Snowflake, ensuring
· modular, testable, and version - controlled transformation logic.
· Experience in implementing the lake house solution, Medallion architecture for financial or insurance carriers
· Experience in o ptimiz ing and tune Snowflake environments for performance, cost, and scalability, including
· query optimization and resource management,
· Experience in architecting/lead migration of workloads from Cloudera to Snowflake
· Design Streamlit apps and define new capabilities and data products leveraging snowflake ML and LLOPS
· capabilities .
· Experience in evaluating the data technology platform including da ta governance suites, data security
· products
· Exposure to enterprise Datawarehouse solution like Cloudera , AWS Redshift and informatica tool sets - IDMC,
· powercenter, BDM
· Develop robust data models and data pipelines to support data transformation, integrating multiple data
· sources and ensuring data quality and integrity.
· Document architecture, data flows, and transformation logic to ensure transparency, maintainability, and
· knowledge sharing across teams.
· Strong knowledge of d ata lifecycle mgmt., data retention, data modelling and working knowledge of cloud
· computing, and modern development practices.
· Experience with data governance, metadata management, and data quality frameworks (e.g., Collibra ,
· Informatica ).
· Experience in converting policy/data conversion from legacy to modern platform
· Deep expertise in Snowflake (Snowpro advanced certification preferred), with hands - on experience delivering
· Snowflake as an enterprise capability.
· Hands - on experience with AWS Glue for ETL/ELT, Apache Airflow for orchestration, and dbt for
· transformation (preferably deployed on AWS ECS).
· Proficiency in SQL, data modeling, ETL/ELT processes, and scripting languages (Python/Java).
