Lead DataOps Engineer

Talent International — Australia · Posted ~3 hours ago

Lead Contract Hybrid

Skills

DataOps Cloud data pipelines AWS Data pipeline development APIs Managed File Transfer AWS Kinesis ETL ELT AWS Glue Informatica dbt Talend Infrastructure automation Data processing

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A lead-level DataOps engineering opportunity on a major government digital program. You will design, build, test, deploy, and maintain secure cloud data pipelines in a fully cloud-based AWS environment, using APIs, streaming, file-transfer patterns, ETL/ELT tooling, and infrastructure automation while collaborating with data specialists.

Highlights

A 12-month contract with a further 12-month extension option, hybrid work, and multiple Australian city options. The role provides leadership-level ownership of secure, scalable cloud data pipelines within a major government digital program.

Description

12-month contract + 12-month extension option Melbourne, Sydney, Brisbane, Canberra or Adelaide Hybrid Baseline Clearance with ability to obtain NV1 A major Federal Government agency is seeking an experienced EL2-level Lead DataOps Engineer to design, build, test and maintain secure, scalable cloud data pipelines. Working within the new mobilising Digital Enrolments, Access and Payments (DEAP) program, you will collaborate with data scientists, analysts, data engineers and technical specialists to deliver reliable data movement and processing capabilities across a complex 100% cloud AWS environment. The Role Design, build, test, deploy and maintain scalable cloud-based data pipelines.Develop data pipeline solutions across APIs, Managed File Transfer, file extracts and other integration patterns.Create and support data processing streams using technologies such as AWS Kinesis.Build ETL and ELT processes using AWS Glue, Informatica, dbt, Talend or similar tools.Automate infrastructure and repeatable engineering tasks using Terraform and scripting.Optimise pipelines for performance, reliability and scalability.Implement appropriate security, access controls and data-protection measures.Monitor data pipelines, troubleshoot issues and maintain technical documentation.Collaborate with data scientists and analysts to understand data requirements.Provide technical design advice and communicate effectively with both business and technical stakeholders.Contribute to delivery within Agile development environments. About You At least five years’ experience working as a Data Engineer, DataOps, or Data Pipeline Engineer in 100% cloud environments (AWS preferred or multi-cloud AWS and Azure).Strong hands-on experience designing, building, testing and deploying different types of data pipelines.Advanced knowledge of AWS data storage, extraction, transformation and processing services.Practical experience with AWS Glue and streaming technologies such as AWS Kinesis.Strong SQL skills and experience with ETL tools.Experience implementing security and access controls around cloud data pipelines.Infrastructure-as-Code (IaaC) experience, ideally using HashiCorp and Terraform.Experience working with Agile methodologies such as Scrum, Kanban, Lean or Extreme Programming.Strong analytical, troubleshooting, and problem-solving capabilities.Excellent communication skills across technical and business audiences.Relevant tertiary ICT qualifications or applicable industry certifications. Nice to Have Experience with GoAnywhere Managed File Transfer.Control-M orchestration experience.CI/CD automation experience using GitHub or Bitbucket.Experience using generative AI to improve software engineering efficiency.Knowledge of specification-driven development and design-first engineering practices.Experience implementing architectural patterns for the safe integration of generative AI tools into the software development lifecycle.Current NV1 or Baseline with ability to obtain NV1. Apply Applicants will be required to submit a Key Selection Criteria response addressing the formal selection criteria (to be provided) before submission closing date 16th September. Proof of Australian Citizenship and ability to pass federal background checks and national criminal history checks will be required. Baseline AGSVA Clearance required at a minimum. For further information, contact Kylie McManus at kylie.mcmanus@talentinternational.com. For over 30 years Talent has been redefining the contracting experience with industry leading support, exclusive contractor benefits & a world-class digital platform ENGAGE to access it all. Apply today to see how we can elevate your career