Senior Software Engineer - Data Platform

2 newly created positions available Build scalable data platforms processing large volumes of streaming & batch data for a leading global mining OEM and technology provider. Brisbane-based, in-office roles. 2 newly created Senior Software Engineer positionsJoin an established specialist technology team of 10 peopleWork within a large global program with teams across Australia, the US, Canada & IndiaBuild with Java/Spring Boot, microservices, Python, Scala, Spark, Kubernetes, Delta Lake & moreWork in a modern software engineering environment making extensive use of AI in development and testing Build the data platforms behind the future of mining technology. We have two newly created Senior Software Engineer positions with a leading global mining OEM and technology provider, developing sophisticated technology used across mining operations around the world. You'll join an established 10-person specialist technology team working within a large global technology program with distributed teams across Australia, the US, Canada and India. We're looking for experienced Senior Software Engineers / Senior Developers with strong backend software engineering skills to help build and evolve a scalable data platform that ingests large quantities of high-frequency telemetry from mobile mining equipment. A major focus of the roles will be designing solutions capable of processing data through both real-time streaming and large-scale batch workloads, while supporting data science, machine learning and predictive modelling. You'll also help transform an existing Java/Spring Boot monolith into a modern microservices-based, containerised, scalable and cloud-ready architecture. What you'll be working on This is a hands-on software engineering role sitting at the intersection of backend engineering, microservices, big data, distributed systems and data platforms. You'll help design and build technology capable of reliably ingesting, processing and storing large quantities of high-frequency machine telemetry, using both streaming and batch data processing. Working alongside software engineers and data scientists, and collaborating with globally distributed teams, you'll help create an environment capable of supporting large-scale data workloads, lakehouse persistence and low-latency predictive model hosting. The broader software engineering group is also making extensive use of AI across software development and testing, providing the opportunity to work with contemporary AI-assisted engineering practices as part of the development lifecycle. Your responsibilities will include: Designing scalable components and microservices for ingesting, processing and persisting large quantities of high-frequency telemetry dataBuilding solutions supporting both real-time streaming and large-scale batch processingCollaborating with data scientists to host, orchestrate and optimise workloads across Python, Scala and JavaBuilding solutions using technologies including Apache Spark, Delta Lake, Redis/Valkey, MQTT and PostgreSQLHelping modernise the existing Java/Spring Boot monolith towards a microservices-based architectureContainerising and deploying applications using Docker and KubernetesIntegrating with S3-compatible object storageContributing to architectural decisions around event sourcing, CQRS and hybrid cloud deploymentsEvaluating emerging technologies including Flink, Trino, Kafka, DuckDB, Dask and Daft to improve performance and scalabilityCollaborating with engineering and technology teams across Australia, the US, Canada and India What we're looking for You'll bring strong backend software engineering experience and be comfortable solving complex problems involving large data quantities, streaming and batch processing, microservices, distributed systems and modern application architectures. Ideally, you'll have: Strong backend software development experience, ideally with Java/Spring Boot, together with experience or the ability to work across Python and/or ScalaExperience designing and developing microservices and distributed applicationsExperience developing large, complex applicationsDemonstrated experience working with large quantities and high volumes of dataStrong experience with streaming and batch data processing, ideally using Apache Spark or similar technologiesExperience with Docker and KubernetesFamiliarity with data lake/lakehouse architectures, particularly Delta LakeKnowledge of messaging and streaming technologies such as MQTT and KafkaExperience with caching technologies such as Redis/ValkeyThe ability to work comfortably across multiple programming languagesExperience designing scalable, multi-tenant or hybrid deployment architecturesExperience collaborating effectively within large, geographically distributed software development environments Previous Data Engineering experience will be highly regarded, as will experience with machine learning algorithms and statistical modelling. Experience within the mining industry would also be beneficial but is not essential. Why consider this opportunity? This isn't your typical enterprise data environment. These are two newly created positions, giving you the opportunity to join an established specialist team while also working as part of a much larger global technology program. You'll be working with large quantities of data generated by real-world mobile mining equipment, tackling challenging engineering problems around streaming, batch processing, microservices, scalability, performance and reliability. You'll have the opportunity to influence architecture, explore emerging technologies and contribute to the evolution of a sophisticated data platform supporting advanced mining technology. Location & Work Requirements These are in-office roles based in Brisbane and are suited to people who enjoy working closely and collaboratively with their team. Candidates currently living within the Greater Brisbane area will be preferred. Due to the requirements of the positions, applications can only be considered from candidates who are: Australian CitizensAustralian Permanent ResidentsNew Zealand CitizensUnfortunately, candidates requiring visa sponsorship cannot be considered for these opportunities. Interested? If you're an experienced software engineer who enjoys working with large-scale data, streaming and batch processing, microservices and modern distributed architectures, we'd love to hear from you. Apply through SEEK or contact Fortunato (Forty) Galluzzo or Katrina Penfold for a confidential discussion and further information about the roles. Fortunato (Forty) Galluzzo M: 0438 870 9417 E: forty@taskgroup.com.au Katrina Penfold M: 0408 737 527 E: katrina@taskgroup.com.au