Databricks DevOps Engineer

Databricks DevOps Engineer – Azure | Terraform | CI/CD 📍 Location: Dallas, TX 💼 Experience: 6–12 years 🏢 Employment Type: Full-Time Job Overview We are looking for an experienced Databricks DevOps Engineer with strong expertise in Azure, Databricks, CI/CD, Terraform, API development, and DevOps automation. The ideal candidate will have hands-on experience building and integrating APIs, developing Terraform modules, and implementing automated CI/CD pipelines. Must-Have Skills 7+ years of experience in API development and 3rd-party API integrationsStrong SQL skills – SQL Server or OracleStrong scripting experience with Python, Bash, and/or PowerShellExperience with Git, GitHub, and/or GitLabStrong understanding of CI/CD pipelines and DevOps best practicesHands-on experience with Azure DatabricksStrong experience with Terraform and Terraform module developmentExperience with Jenkins and GitLab CI/CDExperience with Azure services and securityExperience with:Azure AD / Microsoft Entra IDOAuthJWTAzure AD B2CApp RegistrationsAzure App InsightsAKSSignalRMicrosoft Teams SDKTeams application developmentAzure Bots / Bot FrameworkPreferred / Nice-to-Have Data Engineering experienceStrong understanding of ETL/ELTData modelingData warehousingBig data conceptsWorkflow automation experienceKey Responsibilities Design, develop, and maintain APIs and integrations with third-party applications.Develop and maintain CI/CD pipelines using Jenkins and GitLab CI/CD.Build and maintain reusable Terraform modules and infrastructure automation.Support and manage Azure Databricks environments.Implement DevOps automation and deployment best practices.Work with Azure authentication and authorization technologies including Azure AD, OAuth, JWT, and Azure AD B2C.Support Azure services including AKS, App Insights, SignalR, and App Registrations.Collaborate with data engineering teams on ETL/ELT and Databricks-related initiatives.Troubleshoot technical issues and provide effective solutions across development and deployment environments.Ideal Candidate The ideal candidate combines DevOps + Azure + Databricks + Terraform expertise with strong API development and scripting skills. Excellent analytical, troubleshooting, communication, and problem-solving skills are required.