Data Engineer (Azure Databricks) (Krakow, Wroclaw)

Infinityquest — Poland · Posted ~1 day ago

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Description

Role Summary We are seeking an experienced Azure Databricks Data Engineer to design, develop, and scale data-driven HR solutions across the employee lifecycle. The ideal candidate will have strong expertise in Azure data services, modern data engineering practices, and building scalable, high-quality data platforms. Key Responsibilities Design, develop, and enhance digital data products and technology solutionsAnalyze business requirements and build scalable data pipelines and featuresEnsure quality, security, reliability, and compliance of data solutionsImplement automated testing, deployment, and monitoring (observability)Troubleshoot production issues and ensure system stabilityWork in Agile environments to deliver high-quality solutionsContinuously improve skills and adopt modern data engineering practicesMandatory Skills (Must Have) 8–10 years of strong Data Engineering experienceHands-on expertise in:Azure DatabricksAzure Data Factory (ADF)Azure Data Lake Storage Gen2Azure Analytics ServicesStrong programming skills in Python or Scala (Spark)Strong experience in SQL and data processingGood understanding of Azure Identity (SPN, SAMI, UAMI)Required Technical Skills Experience designing data warehouse and analytics solutions on AzureStrong knowledge of large-scale data processing, data lakes, and data mesh architecturesExperience with ETL tools (Informatica, SSIS, Talend, etc.)Familiarity with Kafka or streaming technologies (good to have)Hands-on experience with Linux or PowerShell scriptingExperience with CI/CD pipelines, Git, and version controlKnowledge of Docker and DevOps practicesExperience with orchestration tools like Apache Airflow (preferred), Autosys, or Control-MExposure to Terraform, ARM templates, YAML, Azure Functions, Logic Apps (plus)Other Requirements Experience working in Agile methodologies (Scrum/Kanban/XP)Strong problem-solving and analytical skillsExcellent communication skills (verbal & written)Bachelor’s degree in Computer Science or related fieldPreferred Qualifications Experience in HR data platforms or employee lifecycle solutionsExposure to cloud-native architecture and DevOps practices