Azure Data Engineer

Azure Data Engineer – Azure Databricks Location: Krakow / Wroclaw, Poland Work Model: Hybrid – 3 days/week Contract - 6 Months Extendable Role Overview We are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks, Azure Data Factory, Spark, SQL and Azure Data Lake. The role involves designing and developing scalable data engineering solutions across the employee lifecycle, with a strong focus on quality, automation, security and reliability. Key Responsibilities Design, develop and enhance scalable data engineering and analytics solutions on Azure.Develop data pipelines and ETL/ELT processes using Azure Data Factory and Azure Databricks.Build and optimise data solutions using Azure Data Lake Storage Gen2, Azure SQL/PostgreSQL and Azure Analytics services.Work with large-volume, multi-format datasets and distributed data architectures.Develop efficient data processing solutions using Spark (Python/Scala) and SQL.Implement automated testing, CI/CD, monitoring and observability.Ensure solutions meet security, reliability, compliance and performance requirements.Collaborate within an Agile/Scrum environment and contribute to continuous improvement.Work with Git-based development, code reviews and DevOps practices. Mandatory Skills Data Engineering experienceStrong hands-on experience with Microsoft AzureAzure DatabricksAzure Data Factory (ADF)Azure Data Lake Storage Gen2Spark – Python/ScalaSQLAzure SQL / PostgreSQLAzure Identity – SPN, SAMI, UAMIData warehouse, data lake and data integration conceptsLarge-scale and multi-format data processingGit/GitHub/GitLab and CI/CDExperience working in Agile SDLC Good to Have Apache Airflow / Autosys / Control-MInformatica / SSIS / TalendKafka / streamingDockerPowerShell / Linux scriptingTerraform / ARM / PuppetAzure Functions / Logic AppsGitLab CI/CD and YAML