Senior Software Engineer - Data Platform

Senior Software Engineer - Data Platform 12 month contract Full-time onsite work required – Brisbane CBD / Remote applicants will not be considered Up to $1000 per day (including Superannuation) We're partnering with a global leader in mining technology to recruit an experienced Senior Software Engineer - Data Platform. This role sits within a specialist team responsible for the platform that powers large-scale machine telemetry processing across mining operations. Working at the intersection of software engineering, data engineering and data science, you'll help modernise a critical platform that ingests and processes high-frequency machine data from hundreds to thousands of assets in the field. You'll join a collaborative Brisbane-based team supported by experienced architects, domain experts and data scientists, contributing to the evolution of a cloud-ready, highly scalable platform that enables advanced analytics, predictive modelling and operational optimisation across mining fleets. What you'll be doingBuild scalable platforms for high-volume telemetry ingestionDevelop streaming and batch data pipelinesModernise legacy applications into cloud-native platformsBuild and optimise workloads using Apache Spark, Apache Flink and related technologiesDesign data lake and lakehouse solutions using Delta Lake and similar platformsPartner with Data Scientists to operationalise Machine Learning modelsDevelop services across Java, Python and ScalaDeploy containerised applications using Docker and KubernetesIntegrate with Kafka, MQTT and event-driven platformsImprove the performance, scalability and reliability of data workflowsContribute to distributed systems and platform architecture decisionsSupport low-latency processing for real-time analytics and insightsAssess emerging technologies to enhance platform capabilityCollaborate with architects and SMEs on complex engineering challengesOwn solutions from design through to production support What you need to bring Strong software engineering experience in backend or data-intensive environmentsAdvanced development skills in JavaCommercial experience with Python and/or ScalaExperience building large-scale data platforms and pipelinesHands-on expertise with Apache Spark, Apache Flink or similar distributed processing frameworksStrong understanding of streaming and batch processing architecturesExperience with Kafka, MQTT or comparable messaging technologiesKnowledge of modern data lake and lakehouse architecturesExperience with Delta Lake, Apache Iceberg or equivalent technologiesStrong experience with Docker and KubernetesExperience designing scalable, distributed systemsUnderstanding of cloud-native and container-based architecturesExperience with PostgreSQL or other enterprise databasesProven ability to work effectively within cross-functional teamsStrong problem-solving, troubleshooting and solution design skills Bonus points for Mining, resources or industrial IoT experienceExposure to machine learning operationalisation or MLOps environmentsExperience with event sourcing and CQRS patternsFamiliarity with Redis, Valkey or distributed caching technologiesExperience with Trino, DuckDB, Dask, Daft or related data platform technologiesPrior Data Engineering experience supporting Data Science teams Important to know Full working rights requiredThis role will require the successful candidate to work on site in Brisbane full-time 5 days per week. Remote applicants will not be considered. If you're a hands-on engineer who enjoys building scalable data platforms, working closely with Data Scientists and solving complex streaming data challenges at scale, we'd love to hear from you. For a confidential discussion or to learn more please reach out to Lakshmi Dhanarajachar on 0419 721 158 or lakshmi.d@clicks.com.au. #DataEngineering #DataPlatform #SoftwareEngineering #ApacheSpark #ApacheFlink #StreamingData #Kafka #Kubernetes #Java #Python #Scala #MachineLearning #DataScience #BigData #Lakehouse #DeltaLake #Iceberg #MiningTechnology #BrisbaneJobs #TechJobsAU #clicksitrecruitment If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Amy Watson at Clicks IT Recruitment on +61 429 171 544. At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply. We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with a disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 257 or email adjustments@clicks.com.au