Data Engineer

Data Engineer As a preferred supplier to one of our biggest Financial Client, I am seeking for a Data Engineer for a position in Utrecht, Netherlands. The successful candidate will design, build and maintain secure, scalable data ingestion and archiving solutions for structured and unstructured data. You develop automated ETL pipelines and searchable archives for decommissioned applications and regulatory data, using technologies such as Python or PowerShell, C#/.NET or JavaScript, React and Hitachi Content Platform. Working with business and technical stakeholders, you test, document and continuously improve solutions that support compliant and efficient data onboarding. Key Responsibilities and Accountabilities: Based on demand build ETL architecture transferring structured and non-structured data into a Hitachi Content Platform (HCP) Object store as the back end for archivingBuild bespoke archives of data to satisfy point business solutions such as regulation and complianceBuild a generic framework to ingest decommissioned application data into searchable archives such that applications may present their data from e.g. a database in a pre-determined format to be ingested in a searchable formDeliver a standard interface for searching such archives securelyAnticipate demand and innovate existing solutionsCode, test, document, and maintain standardised, automated data pipelinesHelp design and build the infrastructure required for optimal extraction, transformation, and loading of data from a variety of data sourcesBuild analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metricsResponsible for testing, documentation and handover to the customer.Delivery to meet aggressive timescales.Communication of progress and risk to the team Business Knowledge/ Technical Skills: Experience building and optimizing big data data pipelines, architectures and data sets.Strong analytic skills related to working with both structured and non-structured datasets.Build processes supporting data transformation, data structures, metadata, dependency and workload management.A successful history of manipulating, combining, processing and extracting value from large disconnected datasets.Experience supporting and working with cross-functional teams in a dynamic environment.Knowledge of SIARD (Software Independent Archiving of Relational Databases)We are looking for a candidate with experience or a strong aptitude in a Data Engineering role, and ideally have experience using the following software/tools: Must have In-depth experience of developing Python or PowerShell scripts across Windows and Linux platformsExperience with at least one of these object-oriented languages: C#, JavaScript or .NetExperience of UI development, ideally with React Desirable Experience with creating playbooks in Ansible Automation PlatformWorking knowledge and experience working with MSSQL and Oracle databasesKnowledge of Hitachi Content PlatformKnowledge of Solr Personal Attributes: Ability to influence effectively at different organizational levels;Courage and determination to challenge current practices;Strong analytical and conceptual skills;Clear written and verbal communication skills in English.Ability to deal with people, across a complex organisation with different cultures and geographiesDemonstrates professional acumen, integrity, discretion, credibility and trustworthinessSelf-motivated, with the ability to work effectively under pressure and results drivenAbility to respond swiftly to changing demands of the businessStrong interpersonal and client relationship/influencing skillsGood time managementWillingness to travel if required Contract: 12+ month Rates: Excellent Location: Utrecht Interview: 2 stages Nick Chinweerapunt Account Manager Gazelle Global Consulting Tel +31 85 111 0171 Tel +44 203 588 7747 Mob +44 7377 403 773 nick@gazellegc.com