Summary
✨ AI‑Generated
Join an operations-focused engineering team maintaining large-scale data infrastructure across cloud and on-premises environments. You will stabilize production workloads, manage containerized deployments and CI pipelines, monitor data quality, maintain infrastructure and access controls, and diagnose issues through logs and root-cause analysis.
Highlights
Work on large-scale data infrastructure spanning cloud and on-premises environments. The role emphasizes ownership, root-cause problem solving, production stability, infrastructure management, and practical use of modern DevOps tooling.
Description
Role
Datago's products run on a large-scale data processing platform, with infrastructure hosted across public cloud and on-premises environments.
Parts of the codebase were developed by former team members, and documentation is being progressively updated.
Engineers are expected to review existing code before modifying it and to address root causes rather than symptoms.
AI assistants are in the workflow but responsibility for all delivered code remains with the submitting engineer.
Responsibilities
Maintain the stability of the crawler fleet.
As target websites change frequently, failures are to be diagnosed from logs and resolved at the root cause.Manage deployments and configuration, including Docker and Compose services, Kubernetes for the production environment, CI pipelines and scheduled jobs.
Monitor data quality and investigate anomalies as they arise.Maintain cloud infrastructure, covering instances, networking, access control and resource management.Perform backups, secrets rotation and system upgrades, and provide incident response for pipeline outages.Work closely with other teams to safeguard collection quality.
Qualifications
1-4 years in a Linux, operations, DevOps or backend role.
Recent graduates with demonstrable operations experience are also welcome to apply.Fluent Cantonese, working proficiency in English for documentation and code, ability to read both Traditional and Simplified Chinese.Strong command-line and bash proficiency, with a track record of diagnosing issues through log analysis rather than trial-and-error restarts.Daily hands-on experience with Docker; exposure to Kubernetes, which is deployed in production, is an advantage.
Proficiency with Git in team workflows.Python proficiency sufficient to read and modify crawler code, working knowledge of SQL for data validation.Solid grasp of HTTP, HTML and JavaScript debugging with browser developer tools.A degree in Computer Science or Engineering, or equivalent experience demonstrable through systems previously shipped or operated.
Preferred Qualifications
Scrapy, Playwright or Selenium, proxies, rate limiting.ClickHouse, Prometheus/Grafana, NAS administration.
Location of work: Hong Kong Science Park
Benefits
Competitive salaryAnnual leave and group medical insuranceGood team culture
