Big Data Developer

E Solutions Global — Poland · Posted ~2 hours ago

Senior

Skills

Scala Java Apache Spark PySpark Python Azure Azure Databricks Docker Kubernetes GitLab CI/CD Maven Gradle Bash Shell ETL/ELT Data pipelines

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build and support scalable Big Data applications and data pipelines using Scala, Java, Python, Spark, and a major cloud data platform. The role combines data engineering, architecture, automated testing, CI/CD, production support, and opportunities to contribute to GenAI and LLM-based solutions.

Highlights

Work on scalable Big Data solutions and pipelines using a modern cloud data stack, participate in architecture decisions, contribute to GenAI initiatives, and gain broad exposure to development, deployment, testing, and production operations.

Description

Role: The role involves designing, developing and supporting scalable Big Data solutions and data pipelines, with strong focus on Scala, Java, Spark and Azure Databricks. 🔹 Responsibilities: • Design and develop scalable data pipelines and applications • Work on ETL/ELT, data processing and data integration • Develop solutions using Scala, Java, Python and Spark • Work with Azure Databricks and Azure services • Participate in architecture and technical design decisions • Develop and maintain automated tests and ensure code quality • Support CI/CD, deployment and production activities • Troubleshoot technical issues and provide solutions • Collaborate with business and technical stakeholders • Contribute to GenAI/LLM-based solutions where applicable 🔹 Mandate Skills: • 4+ years of Big Data / Data Engineering experience • Strong Scala & Java development experience • Apache Spark / PySpark • Azure & Azure Databricks • Docker & Kubernetes • GitLab / CI/CD • Maven / Gradle • Bash / Shell scripting • JUnit / Mockito / Cucumber • Postman / API testing • Experience with ETL/data pipelines and distributed data processing