DontApply.Club
Login Register

Data Engineer

Confiarservices — United States · Posted ~2 hours ago

Mid Full-time

Skills

Python Databricks REST APIs Elasticsearch Kafka Azure REST API

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary ✨ AI‑Generated

A technology team is looking for a data engineer to develop scalable data and search solutions. The role involves backend services, cloud applications, data pipelines, distributed systems, and production reliability.

Highlights

Build scalable data solutions using modern cloud technologies, distributed systems, and search platforms.

Description

Job Summary We are seeking an experienced Data Engineer with strong expertise in Python, Databricks, REST APIs to build scalable data and search solutions. The ideal candidate will have strong production experience with Elasticsearch, event-driven architectures, cloud technologies, and distributed systems. Key Responsibilities Design and develop scalable backend services using Python.Build and maintain enterprise REST APIs.Design and optimize Elasticsearch indexes, mappings, queries, and search relevance.Develop scalable search and intelligent matching capabilities for large datasets.Build event-driven architectures using Kafka and Azure Event Hub.Develop high-throughput data ingestion and indexing pipelines.Integrate applications with Databricks and enterprise data platforms.Deploy and maintain cloud-native applications on Microsoft Azure.Implement CI/CD pipelines and automated deployments.Monitor application health, logging, observability, and production performance.Optimize API response times, Elasticsearch performance, and infrastructure utilization.Participate in architecture discussions, design reviews, code reviews, and production support.Collaborate with product managers, architects, data scientists, and engineering teams.Required Qualifications 7+ years of software/data engineering experience.Strong Python backend development experience.Strong experience designing and supporting production REST APIs.Must have strong production experience with Elasticsearch.Experience designing and operating scalable search platforms.Hands-on experience with Databricks and data engineering platforms.Experience with Kafka, Azure Event Hub, or other enterprise event-streaming technologies.Experience deploying applications on Microsoft Azure.Strong understanding of distributed systems and microservices.Experience with CI/CD and automated deployment pipelines.Strong production troubleshooting and performance optimization skills.