Senior Software Engineer - Query Engines and Storage

Treasure Data Inc — Canada · Posted ~21 hours ago

Senior Full-time

Skills

Software engineering Query engine development Distributed data systems Storage systems Hadoop Hive Trino Large-scale data processing

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A data infrastructure team is seeking a Senior Software Engineer to advance large-scale query engines and storage systems. You will work with distributed data technologies, help evolve high-throughput ingestion and availability systems, and tackle challenging problems in large-scale data processing while maintaining strong technical standards.

Highlights

Work on large-scale data infrastructure processing billions of records daily, with the opportunity to evolve query engines and in-house storage technology.

Description

Treasure AI Treasure AI is the agentic experience platform built to acquire, retain, and grow your most valuable customers. Powered by AI, Treasure AI is shaped by human creativity and always-on through continuous, context-driven action. Furthermore, Treasure AI employees are enthusiastic, data-driven, and customer-obsessed. We are a team of drivers—self-starters who take initiative, anticipate needs, and proactively jump in to solve problems. Our actions reflect our values of honesty, reliability, openness, and humility. Your Role The Plazma team at Treasure AI is one of the essential elements of our CDP solution and is part of the Core Services group, which supports customer data ingestion and availability at a rate of 70B records per day. You are expected to help the team develop the future of our Hadoop/Hive & Trino query engines and expand from there into our in-house developed storage solution. This includes maintaining technical excellence to address challenges that currently lack industry-wide solutions and delivering the roadmap together with your team. Our team consists of Big Data experts across Japan, Korea and Canada who are passionate about OSS contribution, and we take pride in the quality of service we offer. Responsibilities Design and develop Hadoop/Hive & Trino solutions, providing technical expertise for modern data architecture assessment and use case developmentEstablish engineering standards for design, development, tuning, deployment, and maintenance of advanced data access frameworks and distributed systemsCollaborate with your team to define product roadmaps based on operational needs and customer-requested features while mentoring and training new team membersOwn version and release management, including baseline evaluation, patch backporting, and deployment of customer-facing featuresCoordinate with Support and Product teams on release cycles and feature deliveryContribute to Hadoop/Hive & Trino OSS through bug fixes, new features, and technical documentationPartner with SRE to automate cluster operations, reducing operational overhead through automated lifecycle management and load balancing workflowsDesign and implement observability solutions, including health metrics, capacity planning tools, and automated failure detection and recovery systemsProvide expert customer support, including on-call responsibilities, escalation handling, and in-depth troubleshooting of performance and defect issuesDevelop custom technical solutions, including user-defined functions (UDFs) and specialized tooling for Hadoop/Hive & Trino Job Requirements 5+ years building and operating distributed systemsStrong Java and deep understanding of algorithms, data structures, and distributed systems fundamentalsSolid understanding of cloud architecture and services in public clouds like AWS, GCP, or Microsoft AzureStrong capability in implementing new and improved data solutions for multi-tenant environmentsExperience in developing use cases, functional specs, design specs, etc.Experience working with distributed, scalable Big Data stores or NoSQL, including HDFS, S3, Cassandra, Big Table, etc.Strong analytical and communication skills; able to influence across Product, SRE, and Support It Would Be Nice If You Had Understanding of the capabilities of Hadoop/Hive or TrinoProven experience operating production query engines on a petabyte scaleMicroservices architecture, data integration patterns, and extending OSSInfra-as-Code, SRE practices, and advanced observabilityUDF development and familiarity with data visualization ecosystemsSecurity and privacy-by-design expertiseExperience with storage patterns and optimizations for massive parallel processing Physical Requirements Working out of our Vancouver, BC office according to our “Global Hybrid Working Policy.” Travel Requirements Travel requirements typically amount to approximately 5% of the year, including one week in Japan annually, another in Mountain View, CA, and possibly an additional week elsewhere. Perks And Benefits (CAN) Our benefit package showcases our culture of care and empathy with Competitive compensation packagesRestricted Stock Units (RSU)Paid vacation and sick timePaid volunteer and mental health daysUp to 26 weeks paid parental leave including a post-partum night nurse16 Company holidays (includes 2 floating holidays)RRSP with 6% company matchEmployer provided Supplemental medical, dental, disability & life coverageComprehensive support and access to care for everyone, everywhere through Carrot - our global reproductive health and family-building benefit Our Dedication To You We value and promote diversity, equity, inclusion, and belonging in all aspects of our business and at all levels. Success comes from acknowledging, welcoming, and incorporating diverse perspectives. Diverse representation alone is not the desired outcome. We also strive to create an inclusive culture that encourages growth, ownership of your role, and achieving innovation in new and unique ways. Your voice will be heard, and we will help amplify it. Agencies And Recruiters We cannot consider your candidate(s) without a contract in place. Any resumes received without having an active agreement will be considered gratis referrals to us. Thank you for your understanding and cooperation! Treasure AI moves marketing and data teams beyond legacy martech SaaS toward autonomous, ROI-driven AI agents that operate continuously, while keeping the human in the loop. With built-in governance, Treasure AI is powered by an always-up-to-date understanding of each customer for AI to act on. The result is always-on marketing execution that compounds over time: smarter engagement, stronger retention, and measurable growth. Treasure AI’s agentic experience platform is available across web, mobile, and desktop — bringing your customer intelligence to every workflow, wherever your team works.