Summary
✨ AI‑Generated
Develop and optimize cloud-based data systems, pipelines, and architectures while working with advanced analytics technologies.
Highlights
Short-term data engineering opportunity involving modern cloud data platforms and advanced data processing technologies.
Description
Role : AWS Data Engineer
Location: London
Work Mode : 3 days per week onsite hybrid mode
Duration: 3 months
Job Overview
We are seeking a skilled and experienced Data Engineer to join our dynamic team.
In this role, you will be responsible for developing, testing, improving, and maintaining new and existing databases to help users retrieve data effectively.
As a data engineer, you will work closely with our data team to optimize our data systems and pipeline architecture, develop set processes for data mining, data modeling, and data production.
The ideal candidate should be an analytical problem solver, have a deep understanding of data relationship complexities, and be able to strategize and implement database solutions that support and enhance our company's data systems and data quality.
Mandatory Skills : Dbt pyspark, opensearch, knowledge graph , python, iceberg and AWS redshift
Responsibilities
Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
Discover opportunities for data acquisition and new uses for existing data.
Develop data set processes for data modeling, mining, and production.
Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from other systems.
Required Skills
Proficiency in SQL and NoSQL databases.
Strong knowledge of Python, Java, or Scala.
Experience with data pipeline and workflow management tools.
The candidate must have a Bachelor's degree in Computer Science, Software Engineering, or a related field.
A Master's degree or further education in Data Science or a related field is preferred.
Preferred Skills
Familiarity with cloud services like AWS, Google Cloud, or Azure.
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Knowledge of data integration tools like Informatica, Talend, etc.
Understanding of machine learning algorithms and statistics.
Experience with data visualization tools like Tableau, PowerBI, etc.
Knowledge of data warehousing solutions and ETL tools.
Familiarity with data architecture and data modeling techniques.
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Knowledge of software development methodologies like Agile/Scrum.
Understanding of data privacy and governance.
Required Experience
10-15yrs
