Summary
✨ AI‑Generated
A technology and data engineering organization is seeking a Databricks Data Quality Architect and Lead Developer to build robust data quality frameworks. You will define validation rules, detect anomalies, create remediation workflows, optimize data pipelines, and collaborate on scalable data solutions.
Highlights
Lead the design and implementation of data quality frameworks using modern data technologies. The role combines architecture, hands-on development, data engineering, anomaly detection, and remediation workflows in a technically focused environment.
Description
Company Description Pygio Pty Ltd is a full-stack AI integration, software development, and data science company dedicated to transforming ideas into robust, scalable solutions.
The organization focuses on building companies and products for clients by guiding them from concept to implementation.
Rooted in the meaning of the Greek word “πηγή” (source, spring, origin), Pygio positions itself as a source of innovation and technical excellence.
Open-source technologies are central to the company’s approach, enabling flexible, cutting-edge solutions that deliver long-term value for clients.
Role Description The Databricks Data Quality & Remediation Architect / Lead Developer is a full-time, on-site role based in the Cracow Metropolitan Area.
This position is responsible for designing and implementing data quality frameworks on Databricks, including data validation rules, anomaly detection, and remediation workflows.
Daily tasks include building and optimizing data pipelines, collaborating with data engineers and analysts to define data standards, and ensuring data integrity across multiple sources and environments.
The role involves troubleshooting data issues, leading root-cause analysis, and driving remediation strategies to improve reliability of analytics and reporting.
The architect / lead developer will also contribute to best practices, documentation, and technical mentorship within the data team.
Qualifications
Strong Data Analytics and Data Analysis skills to interpret complex datasets and support decision-making.Excellent Analytical Skills for diagnosing data issues, performing root-cause analysis, and optimizing data processes.Proficiency in Data Management and Data Modeling to design robust data structures and maintain high-quality data assets.Hands-on experience with Databricks, Spark, and cloud data platforms (e.g., Azure, AWS, or GCP) for building scalable data pipelines.Knowledge of data quality frameworks, data governance principles, and remediation strategies.Proficiency in SQL and at least one programming language commonly used in data engineering (such as Python or Scala).Ability to collaborate with cross-functional teams, communicate technical concepts clearly, and lead initiatives in a fast-paced environment.Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field, or equivalent practical experience.
