Senior Data Engineer

Acuityanalytics โ€” Malta ยท Posted ~6 days ago

Senior Full-time

Skills

Databricks Azure Cloud ETL/ELT Design Python SQL CI/CD Azure Azure Key Vault Azure Logic Apps Azure Service Bus Azure DevOps Unity Catalog Delta Lake Cosmos DB

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Summary

A globally recognized business specializing in digital transformation and deep data insights for regulated organizations is seeking a skilled Data Engineer. You will be tasked with designing, building, and managing scalable data solutions in a cloud-native environment. Your focus will be on large-scale data orchestration, deploying production-ready machine learning models, and optimizing ETL/ELT pipelines using a robust modern data stack. Collaboration, automation, and performance are at the core of this role.

Highlights

Opportunity to work within a globally recognized, rapidly growing organization. The role focuses on building scalable, automated cloud-native solutions and offers the chance to collaborate closely with cross-functional teams including architects and data scientists.

Description

About the job If you like providing efficient, effective solutions to complex challenges, join us at Ascent! Be at the heart of helping achieve extraordinary things with software and data for our customers! About Us Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We delivers deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency. About the role We are looking for a skilled Data Engineer with strong experience in Databricks, Azure Cloud, and data orchestration to join our team. You will be responsible for designing, building, and managing scalable data solutions in a cloud-native environment, with a focus on automation, performance, and collaboration. Key Responsibilities Build and manage Databricks Workflows for large-scale data orchestration.Develop and deploy PyFunc models and integrate them into production pipelines.Implement secure secrets and configuration management using Azure Key Vault.Automate data flows using Azure Logic Apps.Design and optimize ETL / ELT pipelines in line with best practices.Govern and manage data assets using Unity Catalog and Data Lakehouse patterns.Implement messaging and event-driven workflows with Azure Service Bus.Collaborate with architects, analysts, and data scientists to deliver end-to-end solutions.Utilize Azure DevOps for CI/CD pipeline management Skills Required Data Engineering & Orchestration Databricks Workflows, Unity Catalog, Delta LakeETL/ELT design and implementationData Lakehouse architecture Programming Strong Python skills for data engineering, automation, and integrationExperience writing modular, production-ready codeCI/CD pipelines for Databricks and Azure Databases Strong knowledge of SQL (including query optimization and data modeling)Exposure to NoSQL databases (e.g., Cosmos DB) Azure Cloud Services Azure Key VaultAzure Logic AppsAzure Service BusAPI Management (APIM) Nice to Haves AI & Cognitive Services Experience with Microsoft Cognitive Services (OCR, Layout, Form Recognizer, etc.)Integration of cognitive services into data pipelines Architecture & Monitoring Familiarity with event-driven and microservices architecture patternsExperience with monitoring tools like Datadog, Application Insights, or similar Collaboration & Methodologies Agile team collaborationDevOps practices Why join us People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details.