Big Data Engineer

Ubique Systems — Poland · Posted ~3 hours ago

Skills

Scala Java Apache Spark Azure GitLab Docker Kubernetes Databricks PostgreSQL Maven Shell Azure CLI Azure AD HashiCorp Vault CI/CD Automated testing Spark ARM

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build and maintain large-scale data engineering solutions using Scala, Java, Spark, and cloud technologies. The role covers data processing, containerized workloads, cloud security, infrastructure automation, monitoring, API testing, and end-to-end test automation.

Highlights

Broad exposure to big data engineering, cloud infrastructure, Spark and Databricks, container platforms, security, monitoring, infrastructure as code, and automated testing.

Description

Tech skills: Scala, Java, Spark, Shell, Azure, Sonar, docker hub, container registry, nexus, Postman, Azure CLI • Programming Language: Scala, Java, Spark • Tools: Gitlab, Sonar, docker hub, container registry, nexus, Postman, Azure CLI • Build Scripting: Gradle, Maven, Shell • Packaging Tool/Technology: Shell • Cloud Technology: Azure • Hosting: Experience with container management platforms like Kubernetes and databricks • Data: Storage accounts, PostgreSQL, knowledge on Spark and Data Bricks API, • Security: Azure AD (SAML Token based, Single sign-on), Hashi corp Vault, Managed Identities (Service Principals) • Monitoring: Log Analytics, Azure Metrics, Azure Monitor, • Infrastructure as Code (IaC): ARM Test Automation: • Test Frameworks: Cucumber, Junit, Mockito • Tools: Gitlab, Sonar, docker hub, container registry, nexus, Postman • Build Scripting: Maven, Shell • Service / API Test: I want to test your endpoints as thoroughly as possible • End to End Test: of the integrated system (continuous integration can be a major help here) • Solid knowledge of QA methodologies, test planning, system dependencies, and product integration phases