DontApply.Club
Login Register

Data Engineer - Quantitative Data Platform

Radley James — United States · Posted ~3 hours ago

Senior Full-time Onsite Visa History ✓

Skills

data engineering data infrastructure ETL pipelines large-scale data processing data quality storage backfills batch data architecture streaming data architecture ETL batch processing streaming data architectures

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build and scale a high-performance data platform supporting quantitative investment research and data-intensive workloads. You will develop ingestion and ETL pipelines across petabyte-scale datasets, design batch and streaming architectures, solve data quality and storage challenges, and partner closely with quantitative researchers and engineers.

Highlights

High compensation potential with performance bonus, work on petabyte-scale datasets, and close collaboration with quantitative engineers and researchers on high-performance investment data infrastructure.

Description

Data Engineer – Quantitative Data Platform Location: New York, NY Compensation: Up to $250,000 base + performance bonus I’m working with a leading investment firm in New York that is looking to hire an experienced Data Engineer to help build and scale a high-performance data platform supporting quantitative investment teams. This is a highly technical engineering role focused on large-scale data infrastructure, backtesting and research workloads. You’ll be working with petabyte-scale datasets and partnering closely with quantitative engineers and researchers. What you’ll be working on: Building and scaling data infrastructure for backtesting and other data-intensive applicationsDeveloping ingestion and ETL pipelines operating across petabyte-scale datasetsSolving challenges around data quality, storage, backfills and high-performance data consumptionDesigning batch and streaming data architecturesWorking closely with quantitative researchers and engineering teamsImproving the scalability, reliability and performance of distributed data systems What we’re looking for: 5+ years of experience in data-intensive engineeringStrong SQL and database expertise, particularly with large-scale or time-series datasetsStrong programming skills in Python, Rust and/or C++Experience with tools such as Pandas, Polars, Dask or PySparkExperience building data platforms, ETL systems, data lakes, warehouses or lakehouse architecturesKnowledge of Parquet, Arrow or similar columnar formatsExperience with distributed systems technologies such as Kafka and RedisStrong understanding of performance optimisation and debugging Nice to have: ClickHouse, Snowflake or similar technologiesFinancial markets / quantitative investment experienceREST API developmentPrometheus, Grafana or SentryWhy join? You’ll have the opportunity to work on genuinely large-scale data engineering problems where performance and reliability matter, while building infrastructure used directly by quantitative investment teams. Compensation: $175,000 to $250,000 base + bonus Location: New York, NY