Summary
✨ AI‑Generated
A senior data engineer will design and optimize large-scale data solutions, build reliable pipelines, and support AI and machine learning initiatives using modern cloud data technologies.
Highlights
Advanced data engineering role focused on AI, analytics platforms, scalable pipelines, and independent technical ownership.
Description
About the Company:
At Syncredible Solutions, we believe in the transformative power of technology.
we specialize in Digital transformation services, Enterprise solutions, Power BI Analytics solutions and staffing services.
Job Summary:
We are looking for a senior, fully hands-on engineer with strong expertise in Azure Databricks, Medallion Architecture, AI, and Machine Learning.
The ideal candidate should be able to design, develop, implement, optimize, and troubleshoot data and AI/ML solutions independently.
Key Responsibilities
Design and implement scalable data engineering solutions using Azure Databricks.Build and maintain Bronze, Silver, and Gold layers using the Medallion Architecture.Develop data pipelines using PySpark, Spark SQL, Python, and Delta Lake.Implement data ingestion, transformation, cleansing, validation, and optimization processes.Develop and operationalize AI/ML solutions within the Azure Databricks ecosystem.Work with MLflow, Azure Machine Learning, and related MLOps capabilities.Build and optimize machine learning models and production workflows.Implement data quality, governance, security, and monitoring practices.Optimize Spark jobs, Delta tables, clusters, and overall Databricks performance.Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Azure Synapse, Key Vault, and Azure ML.Develop production-ready notebooks, pipelines, frameworks, and reusable components.Troubleshoot complex data, Spark, ML, and production issues.Collaborate with data scientists, architects, engineers, and business stakeholders.Required Skills
Strong hands-on experience with Azure Databricks.Deep understanding of Medallion Architecture (Bronze/Silver/Gold).Strong PySpark, Python, Spark SQL, and SQL skills.Extensive experience with Delta Lake.Strong understanding of AI/ML concepts and implementations.Experience with MLflow and MLOps.Experience with Azure Machine Learning.Strong knowledge of Azure Data Lake Storage Gen2.Experience with Azure Data Factory and cloud-based data pipelines.Strong understanding of data modeling, ETL/ELT, and data engineering best practices.Experience tuning and optimizing Databricks/Spark workloads.Experience deploying production-grade data and ML solutions.
Equal Opportunity Statement:
Syncredible Solutions is an equal opportunity employer.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.