Summary
✨ AI‑Generated
Join a pragmatic engineering team building a next-generation cloud-native data platform for a global trading business. You will develop event-driven ingestion connectors for external data providers, implement scalable query services, preserve compatibility with existing applications, and help migrate critical workloads without disrupting users. The role offers greenfield development, collaboration with experienced engineers, and the opportunity to solve complex challenges involving real-time and end-of-day financial data.
Highlights
Build a greenfield, cloud-native data platform alongside highly experienced engineers. Work on real-time market data integration, scalable event-driven systems, and backward-compatible APIs while contributing to migration planning, technical experimentation, and the expansion of data capabilities.
Description
JUXT is partnering with a leading global commodities trading firm to build its new core data platform for real-time and end-of-day market data.
During this mission we’ll replace an existing system with a new highly scalable cloud-native data platform, without breaking client applications that rely on this data today.
We’ll build new data ingestion pipelines to consume from a wide variety of market data providers.
We will also build new query capabilities that are compatible with existing APIs, so that client applications keep working unchanged.
This is a greenfield build with a pragmatic team that likes to prove solutions quickly and iterate.
You’ll work alongside highly experienced engineers to plan the migration, build and deploy new systems, analyse existing traffic and prioritise, then expand feeds and query APIs to cover new use-cases.
Responsibilities
Building the feed ingestion subsystem: event-driven connectors pulling data directly from external market data providers.Building query APIs using modern scalable data technologies like ClickHouse and S3 Tables/Iceberg with Athena.
Experience with other massively scalable data tech is beneficial (QuestDB, Snowflake, DuckDB).Building an intercepting proxy to intelligently direct traffic towards new query services.
Achieving faithful API compatibility so that clients can continue to operate correctly.Gathering and analysing metrics and request payloads to discover and survey existing data clients.
Validating the design end-to-end against real client requests, and rolling out new systems in carefully staged steps.End-to-end observability across every component: logs, metrics and traces into ClickStack and Grafana, augmented by AWS observability services.Working carefully to guide the client, learning through discovery sessions, and thinking carefully about platform architecture (streaming vs request-response use cases, staged and low-risk roll-outs, tracking data licenses, high-frequency feed downsampling).
Requirements
A strong senior backend engineer, comfortable across the languages in play on a data platform (e.g.
Java, C#, Python) and experienced in building production data-intensive services.Real experience with data pipelines and event-driven ingestion: connectors, schedulers, idempotency, backfill, and the operational care that feeds demand.Solid networking fundamentals: DNS, TLS and certificates, OSI model, TCP packet analysis, HTTP proxying: enough to reason confidently about a transparent interception layer and debug it when reality intrudes.Experience with scalable cloud data platforms, ideally AWS: object storage, table formats, query engines.Strong testing discipline.
Validation, reconciliation, and careful roll-out.High autonomy and clear communication: a small senior team, embedded with the client, making pragmatic decisions and explaining them well.
They will need to take ownership of significant tasks, design solutions and deliver.
Highly Valued But Not Essential
Market data domain experience: Platts, Argus, ICE, CME, Bloomberg, Refinitiv, entitlements and licensing, curves and time series.Commodities or energy trading domain knowledge, or exposure to Risk / ETRM systems.Hands-on Envoy/HAProxy/Kong/Traefik experience.ClickHouse, Trino/Iceberg, or similar analytical storage and query engines at scale.Experience with staged migrations off a legacy or vendor system, where the old and new run side by side and cut over incrementally.
We offer
Opportunity to work on bleeding-edge projectsWork with a highly motivated and dedicated teamCompetitive salaryFlexible scheduleBenefits package - medical insurance, sportsCorporate social eventsProfessional development opportunitiesWell-equipped office
About Us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services.
Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation.
A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience.
Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
