Data Platform Engineer (DevOps)

Tecsys Inc โ€” Canada ยท Posted ~1 day ago

๐Ÿ”“ Log in to save this job, tailor your resume & track your apply process โ€” 7 days free, no card needed.

Log in to add to target list

Description

Having recognized the advantages of remote work, including employee morale, productivity, reduced commuting on employee wellbeing and the environment, we are proud to be a digital-first company. The technologies and programs in which we invested have provided a fantastic foundation to this end. Our digital-first work environment, together with our conveniently located offices and collaborative workspaces, provide our team with the freedom and flexibility to work in the way that makes our employees most productive. About Us Tecsys is a fast-growing innovator offering supply chain solutions to industry leading healthcare systems, hospitals, and pharmacy businesses to distributors, retailers, and 3PLs. We work with industry leaders to transform their supply chains through technology. If you thrive on tackling interesting challenges with continuous learning opportunities, then Tescys could be a good fit for you! We're looking for a Data Platform Engineer (DevOps) to join our TecsysIQ Data & AI team. This is a hybrid role that builds and operates the cloud data platform powering our analytics and AI products on Databricks and AWS. You will own the infrastructure-as-code and delivery pipelines that provision and deploy the platform, and the Databricks jobs and streaming pipelines that move and shape data through it. You'll partner closely with Data Platform Developers, application dev teams, and Product Owners โ€” standing up new customer environments, evolving the CI/CD and release process, and creating and maintaining the data pipelines that keep the platform running reliably at scale. If you are equally comfortable writing Terraform and debugging a Spark Structured Streaming job, this role is for you. Responsibilities Platform & DevOps Provision and evolve AWS and Databricks accounts and workspaces using Terraform across multiple regions and environments, managing remote state and per-environment configurationOwn the Helm charts and Kubernetes Jobs that onboard new customer environments and deploy the application layer onto provisioned workspacesBuild and maintain Docker images and the Java/Maven build pipeline, publishing artifacts to internal artifact and container registriesIntegrate build, test, and deployment into CI/CD pipelines, and improve release management and versioning across interdependent repositoriesManage secrets and credentials safely through cloud secret management and Kubernetes โ€” never in source control Data Platform & Pipelines Design, build, and maintain Databricks jobs and pipelines โ€” including data curation, transformation, and initial bulk-load workflowsDevelop and operate real-time streaming and change data capture (CDC) pipelines across the ingestion and transformation layers using Spark Structured StreamingBuild and evolve end-to-end data movement across the Bronze, Silver, and Gold data layers, extending pipelines to handle new sources and schema changes as the platform growsDevelop and maintain reusable pipeline components and frameworks so new data workflows can be onboarded and shipped quicklyTune clusters and SQL warehouses for cost and performance, and manage catalog, schema, and access governance across environmentsCollaborate with Data Platform Developers, Product Owners, and business stakeholders in an Agile environment to deliver high-quality data products Requirements Qualifications Hands-on experience with Databricks and Apache Spark, including building batch or streaming data pipelines (mandatory)Strong Terraform skills and comfort managing cloud infrastructure on AWSWorking knowledge of Kubernetes and Helm, and containerization with DockerProficiency in Python (PySpark) and/or Java, plus strong SQL for data validation and troubleshootingExperience with Git-based workflows and CI/CD pipelines in a multi-repository codebaseUnderstanding of data quality, ETL/ELT, and data observability conceptsExperience working in Agile teams alongside Data Platform Developers and Product OwnersStrong analytical, problem-solving, and communication skills We understand that experience comes in many forms and that careers are not always linear. If you don't meet every requirement in this posting, we still encourage you to apply. At Tecsys, we are committed to fostering a diverse and inclusive workplace where all employees feel valued, respected, and empowered. We believe that diversity drives innovation and strengthens our ability to deliver exceptional solutions. We welcome and encourage applicants from all backgrounds, experiences, and perspectives to join our team. Tecsys is an equal opportunity employer. Accommodation is available for applicants selected for an interview. NB: if you are applying to this position, you must be a Canadian Citizen or a Permanent Resident of Canada, OR, have a valid Canadian work permit.