DontApply.Club
Login Register

Big Data Engineer (Spark/Scala/Java)

Luxoft — Poland · Posted ~1 day ago

Mid Full-time Visa History ✓

Skills

Spark Scala Java Azure Big Data Cloud Computing

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

As a Big Data Engineer, you will design and implement large-scale data solutions using Spark, Scala, and Java on a cloud platform. You will work on a scalable, cost-efficient infrastructure with open architecture and automated data lineage, supporting multiple business domains such as front office, finance, and risk. The role involves collaborating with cross-functional teams to enable them to leverage the platform's capabilities, ensuring regulatory compliance and operational excellence.

Highlights

Competitive benefits including laptop and monitor, private medical and dental care, life insurance, well-being program, internal mobility opportunities, and access to training platforms.

Description

🔥Become a Luxoft employee🔥 Our Benefits: 💰Paid Referrals 💻Equipment: laptop and monitor 🩺Private Medical & Dental care & Life Insurance covered 🏋🏽 ♀️ MyBenefit program (sports card, well-being program etc.) 🌎 Internal Mobility program - possibility of rotation between projects, locations, accounts 🎓 LuxTalent platform (webinars, training, courses) ...and more! Project Description: ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver: • Scalable cost-efficient infrastructure, using cloud PaaS components. • Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage. • Shared across Front Office, Finance and Risk, improving regulatory compliance. • One-Platform / One-Experience -fast to train, easy to operate, retaining talent. The ACQA platform is made up of a series of components providing the next generation valuation and risk management services. Responsibilities: • Work with multiple federated teams to enable them to build Big Data solutions • Manage the ACQA Databricks platform – provide monitoring and other tooling • Provide best practices for runtime upgrades Mandatory Skills Description: • Development of big data technologies like Apache Spark and Azure Databricks • Programming complex production systems in Java and Scala • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure) • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab • Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes Nice-to-Have Skills Description: • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure) • Python experience • Testing and instrumentation practices, observability and alerting tooling • Understanding of information modelling, data structures and algorithms • Technical architecture and low-level design • Agile development and planning practices • Ability to collaborate effectively in a large global team and influence key architectural decisions Languages: English: B2