Data Platform Engineer

The Data Platform Engineer (Azure) is responsible for building, automating, and operating the infrastructure that supports the organization's enterprise data platform. This role ensures data pipelines, cloud environments, and platform services are reliable, scalable, secure, and observable across Microsoft Azure. The position focuses on Infrastructure as Code (IaC), DevOps, CI/CD automation, cloud operations, platform governance, FinOps, security, and Site Reliability Engineering (SRE) practices. The Data Platform Engineer partners closely with Data Engineering, IT Infrastructure, Cybersecurity, and Business stakeholders to deliver a stable and high-performing data platform that supports analytics, reporting, and enterprise data initiatives. Essential Duties & ResponsibilitiesCloud Infrastructure & Platform EngineeringDesign, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.Build and support highly available, scalable, and secure Azure cloud environments.Configure and maintain Azure networking components including:Virtual Networks (VNETs)Private EndpointsNetwork Security GroupsAccess Security PoliciesCI/CD & AutomationBuild and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.Automate deployment of:Azure Data FactoryDatabricks NotebooksData PipelinesInfrastructure ComponentsPlatform ServicesEstablish deployment standards and environment promotion processes across Development, QA, and Production environments.Manage source control, versioning, branching strategies, and release processes.Databricks AdministrationAdminister and govern Databricks workspaces.Manage:Cluster ProvisioningCluster PoliciesCost ControlsUnity CatalogAccess ControlsIdentity ManagementSupport data engineering teams by maintaining a reliable Databricks platform environment.Data Storage & Platform GovernanceManage Azure Data Lake Storage Gen2 environments.Configure:Access Control Lists (ACLs)Lifecycle Management PoliciesEncryption StandardsStorage Optimization PoliciesEnsure compliance with data governance and security requirements.Monitoring, Reliability & OperationsImplement observability and monitoring strategies using:Azure MonitorLog AnalyticsAlerting ToolsOperational DashboardsMonitor platform performance and reliability.Troubleshoot:Infrastructure FailuresPerformance BottlenecksPlatform IncidentsCloud Service IssuesParticipate in incident response and root cause analysis activities.Security & ComplianceAutomate secrets and credential management using Azure Key Vault.Support identity and access management initiatives.Partner with Information Security teams to maintain compliance with governance and security standards.Implement secure deployment and infrastructure management practices.Cost Management & Optimization (FinOps)Monitor Azure and Databricks cloud consumption costs.Analyze usage trends and identify optimization opportunities.Recommend cost-saving initiatives while maintaining platform performance and reliability.Documentation & Operational ExcellenceDocument:Infrastructure ArchitectureOperational ProceduresRunbooksIncident Response ProcessesPlatform StandardsEstablish best practices for platform reliability and operational support.QualificationsEducationBachelor's degree in Computer Science, Information Systems, Engineering, or related field required.Experience5+ years of experience in: DevOpsPlatform EngineeringSite Reliability Engineering (SRE)Cloud InfrastructureRelated technical disciplines3-5+ years of hands-on experience with: Microsoft AzureDatabricksAzure Data ServicesCloud Infrastructure ManagementPreferred ExperienceEnterprise data platform environments.Financial, Operations, or Digital data ecosystems.Retail, restaurant, or multi-unit organizations.Large-scale cloud-based analytics platforms.Technical SkillsRequiredMicrosoft AzureAzure Data FactoryAzure Data Lake Storage Gen2Azure Key VaultAzure MonitorLog AnalyticsAzure FunctionsLogic AppsDatabricksTerraformBicep / ARM TemplatesAzure DevOpsGitHub ActionsGit Source ControlCI/CD Pipeline DevelopmentPython and/or PowerShellCloud NetworkingCloud Security ConceptsInfrastructure as Code (IaC)PreferredUnity CatalogDockerKubernetes / AKSGitOpsObservability PlatformsFinOps PracticesSecure Credential ManagementBranching & Environment Management StrategiesPower BI Infrastructure SupportPower BI GatewaysPower BI Service AdministrationCertifications (Preferred)Microsoft Azure Fundamentals (AZ-900)Microsoft Azure Administrator Associate (AZ-104)Azure Data Engineer Associate (DP-203)Azure DevOps Engineer Expert (AZ-400)Databricks Certified Data Engineer AssociateDatabricks Certified Data Engineer Professional Equal Opportunity Employer This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.