DontApply.Club
Login Register

Data Engineer

Wearehaystack — United States · Posted ~7 hours ago

Mid Full-time

Skills

data engineering batch processing distributed processing real-time data processing SQL NoSQL Apache Spark Hadoop data governance data retention data platform development AWS or Azure software development Azure AWS

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

Build and support highly available data pipelines spanning batch, distributed, and real-time processing for analytics at scale. You will translate business and technical needs into reliable data platforms, establish governance and retention practices, and improve operations through automation, monitoring, documentation, performance analysis, and root-cause resolution. A strong background in SQL, NoSQL, Spark/Hadoop, and cloud data platforms is expected.

Highlights

Opportunity to build highly available data pipelines for analytics at scale across batch, distributed, and real-time processing. The role combines hands-on data engineering with governance, automation, monitoring, reliability, and cross-functional collaboration.

Description

We're hiring on behalf of a Haystack partner! The Role • Build and support highly available data pipelines across batch/distributed and real-time processing to enable analytics at scale. • Translate strategic needs into working solutions by partnering across teams to define requirements, implement data governance and retention practices, and improve standards and reliability. • Drive operational excellence through automation, monitoring, documentation, performance analysis, and root-cause resolution. • Partner across peer support groups and vendors as needed to ensure smooth operations. What You'll Need • Bachelor’s degree in Computer Science, Management Information Systems, or related discipline. • 2+ years of professional industry experience with software development. • 5+ years working with SQL platforms. • 2+ years working with (or strong exposure to) NoSQL platforms. • 5+ years working with Spark and/or the Hadoop ecosystem. • 1+ years implementing data platforms on Azure or AWS. • Proficiency in Java, Scala, or C#, plus strong debugging, troubleshooting, and performance tuning skills. What's On Offer • Competitive salary. • Comprehensive benefits package including medical, dental, vision, and life insurance. • Access to disability insurance, paid parental leave, and paid time off. • Retirement savings plan with employer match and stock purchase options. Apply via Haystack today!