AI Software Engineer (Model Training)

About The Role Maincode is training Matilda, the first large language model built and trained from scratch in Australia. Our new compute cluster is live, and we are now scaling the next version. This role sits directly inside that training stack. You will build the pipelines, infrastructure, and tooling that determine how efficiently Matilda trains, how stable long runs are, and how fast new experiments can be executed. Training runs last days or weeks. Small changes propagate through complex systems. The work requires precision and patience. We build AI systems from first principles: designing the architectures, running the infrastructure, shaping the training process, and operating the models ourselves. Matilda is not a research prototype. It is a production system, trained at scale and served for open public access. Maincode operates one of the largest private AI compute environments in Australia, built for a single purpose: training our own models. This is not a role that wraps external APIs or ships user-facing features. You will be working on the systems that train a large language model from scratch. What You Would Actually Do You will build and maintain the systems that support large scale model training. This Includes Designing and maintaining distributed training pipelines for large language modelsBuilding data ingestion and preprocessing systems for large training datasetsDeveloping tooling for experiment management, checkpointing, and reproducibilityMonitoring and debugging long running training jobs across clustersImproving reliability and observability across the training stackOptimising training throughput across compute, memory, and data pipelinesWorking closely with researchers to translate experimental ideas into training runsDiagnosing failures across infrastructure, training loops, and data pipelines Training runs can last days or weeks. Small changes propagate through complex systems. You will spend time inside code, logs, dashboards, and experiment outputs. The goal is simple: make large scale training reliable. The Kind Of Person Who Does Well Here We are looking for engineers early in their careers who want to understand how large models are actually trained. You may have one or two years of experience building production software. What matters most is curiosity and the willingness to learn how these systems behave under load. People Who Tend To Do Well Here Care about how systems behave over long runtimesEnjoy debugging complex distributed systemsPay attention to logs, metrics, and system behaviourPrefer understanding how a system works rather than relying on abstractionAre comfortable working close to infrastructureHave the patience to diagnose failures that appear hours into a runWant to learn how large scale AI training actually happens You do not need prior experience training large language models. What matters is intellectual curiosity, persistence, and the ability to learn quickly. How You Would Work You will write production code that sits directly in the training stack. You Should Be Comfortable Working in PythonUsing machine learning frameworks such as PyTorch or JAXWriting reliable infrastructure for large compute workloadsDebugging distributed systems and long running jobsCollaborating closely with researchers and infrastructure engineers Much of the work sits between research and infrastructure. Ideas move quickly, but the systems that support them must remain stable. What This Role Is Not It is not primarily about building user facing applicationsIt is not about prompt engineeringIt is not about wrapping external APIs or third party models You will be working on the systems that train our own models from scratch. Why Maincode Maincode builds AI systems end to end. We prepare the data, design the training process, run the infrastructure, and operate the models ourselves. You Will Work With a Small Team That Builds the full AI stack rather than outsourcing itTreats infrastructure as part of the intelligence system itselfValues engineers who want to understand how things actually workIs building long term capability in training and operating large models If you want to work directly on the systems that train large language models from scratch, this is the only role in Australia that will put you inside that work. Note This is a full time role based in Melbourne, working closely with our in person engineering and research team. At this time we are not able to offer visa sponsorship, so applicants must have existing and unrestricted work rights in Australia.