DontApply.Club
Login Register

Python Data Engineer

Zapnix — Canada · Posted ~1 day ago

Mid Full-time

Skills

Python Apache Spark PySpark Data engineering API development Database integration HBase Hive

🔓 Log in to save this job, tailor your resume & track your apply process — 7 days free, no card needed.

Log in to add to target list

Summary

A data engineering position focused on developing Python-based applications, processing large datasets, building backend services, and optimizing data workflows using distributed processing technologies.

Highlights

Opportunity to develop data-driven solutions, work with large-scale processing technologies, and build backend systems using modern engineering practices.

Description

Job Title: Data Engineer/ Python Developer Mississauga, Canada Fulltime Mandatory Skills: Python, Spark Pyspark Must Responsibilities: Design, develop, and maintain software solutions using Python.Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..Develop back-end services, APIs, and integrate databases.Optimize applications for performance, security, and maintainability.Troubleshoot and resolve software defects and issues.Required Skills: Strong proficiency in Python and Spark.