Summary
✨ AI‑Generated
A technology services organization is seeking a data architect to design and implement scalable cloud data platforms. The role focuses on data pipelines, lakehouse architectures, integrations, and collaboration with technical stakeholders.
Highlights
Opportunity to design scalable data platforms and work on modern cloud-based analytics solutions in an innovation-focused environment.
Description
About The Role
In this role, you will contribute to designing and implementing scalable data platforms on AWS with a strong focus on the Databricks ecosystem.
You will work with both batch and streaming data solutions, collaborate with technical and business stakeholders, and support architecture and delivery activities across the full project lifecycle within a collaborative and innovation-driven environment.
Responsibilities
Design and support implementation of scalable data solutions using Databricks on AWSDevelop and maintain batch and streaming data pipelines and Lakehouse architecturesCollaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plansSupport data ingestion activities, including source-to-target mappings and integration of new data sourcesParticipate in architecture discussions and contribute to scaling the data platform and maintaining data modelsWork with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA to manage workflowsSupport implementation of real-time data processing solutions using Apache Kafka, Amazon MSK, or KinesisUtilize data warehousing solutions such as Snowflake or Amazon Redshift for analytics and storageCreate and maintain technical documentation, data schemas, and solution-related materialsParticipate in the full project lifecycle, from PoC and MVP stages to production implementationExplore new technologies, build prototypes, and contribute to knowledge sharing within the engineering community
Requirements
Proven experience designing scalable data platforms and data pipeline architecturesHands-on experience with batch and streaming data processing solutionsStrong expertise in AWS cloud services and Databricks platform components, including Delta Lake, Unity Catalog, Workflows, and JobsProficiency in Python, Scala, or Java (preferably Python), along with strong SQL skillsKnowledge of big data technologies such as Apache Spark or FlinkExperience with orchestration tools such as Databricks Workflows, Apache Airflow, or MWAAPractical experience with streaming technologies such as Apache Kafka, Amazon MSK, or KinesisFamiliarity with data warehousing solutions such as Snowflake or Amazon RedshiftExperience participating in customer-facing and pre-sales activities, including workshops, architecture discussions, and solution presentationsUpper-intermediate or higher level of English
SoftServe is an equal opportunity employer.
Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
