Description
Job Title: Data Engineer
Role Overview
We are partnering with a growing consumer retail brand that is investing in its data and analytics capabilities to better support business decision-making across the organization.
This is a small, hands-on data team, and the role extends beyond writing SQL and Python, you'll help maintain the development and runtime environments that the data pipelines depend on, and will be expected to troubleshoot issues across the application, orchestration, container, and infrastructure layers.
This role reports into the data and analytics leadership team.
You don't need to be a dedicated DevOps engineer, but you should be comfortable going below the data layer when something breaks, investigating Python code when a pipeline fails, digging into Docker when a container won't start, inspecting orchestration workers and their logs, or troubleshooting credentials, networking, dependencies, and the runtime environment.
This role suits someone who enjoys understanding how the entire data workflow operates and takes ownership of making it reliable.
Key Responsibilities
Build, deploy, and maintain production ETL/ELT pipelines using Python and SQLDevelop and maintain data models in a cloud data warehouse using modern data engineering practicesOwn scheduled and event-driven workflows from source ingestion through downstream deliveryDevelop, deploy, and troubleshoot workflows running through orchestration platforms such as Prefect, Airflow, or DagsterBuild and support containerized data applications and pipelines using DockerHelp maintain reproducible local and production development environmentsMonitor production pipelines and proactively identify failures, stale data, data-quality issues, and infrastructure problemsTroubleshoot issues across Python applications, containers, orchestration workers, APIs, networking, credentials, and cloud infrastructureImplement logging, alerting, retries, validation, testing, and recovery/backfill strategiesUse Git-based development workflows including branches, pull requests, code review, and controlled production deploymentsHelp establish and improve engineering standards around CI/CD, environment management, testing, observability, documentation, and deploymentWork directly with analysts and business stakeholders to understand requirements and translate business problems into reliable data solutions
Education & Qualifications
Strong SQL and Python skillsExperience developing production ETL/ELT pipelinesHands-on experience with a workflow orchestration platform such as Prefect, Airflow, Dagster, Kestra, or similarHands-on Docker/container experience, including building, running, debugging, and maintaining containerized applicationsExperience supporting production data pipelines and troubleshooting failuresExperience with Git and collaborative software development workflowsExperience with a cloud data warehouse (e.g., Snowflake or similar)Understanding of data validation, monitoring, logging, retries, idempotency, and production recovery
Preferred Experience
Experience administering or supporting orchestration workers/agents and their runtime environmentsCI/CD experience for data applications and pipelinesExperience with a major cloud infrastructure provider (AWS, Azure, GCP, or DigitalOcean)Experience with container registries, environment variables, secrets management, and application configurationLinux/server administration and troubleshooting experienceInfrastructure-as-code experience such as TerraformExperience with dbt or similar transformation frameworksExperience managing development, test, and production environments
Why Our Client
Opportunity to join a company making meaningful investments in its data and analytics capabilitiesSmall, collaborative data team with high visibility and ownershipExposure to the full data workflow, from pipelines to infrastructureStable, established organization with a strong brand presenceOpportunity to shape engineering standards and practices on a growing team
Compensation, Benefits And Perks
Competitive salary and incentivesInclusive benefits package including 401(k), medical, dental, and visionGenerous paid time offProfessional development and growth opportunitiesCollaborative and innovative work environment
Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.
This position does not offer sponsorship.