linkedin

Connecting...

Job Search / Software Development and Engineering

Senior Data Engineer

Location
Den Haag, South Holland
Salary
€70 - €90 per hour
Job Type
Contract
Ref
BBBH32122_1673448365
Contact
Leon Heyse


Senior Data Engineer (Freelance)

Contract Length: 12 months (renewable)
Rate: 70 - 90 € per hour
Techstack: Python, PySpark, Azure Cloud
Language: English
Location: The Hague, NL (hybrid)

This is a freelance opportunity for one of my clients, a globally known company. You will be working for the trading division, the project is about a trading software product for commercial use.

Accountabilities:
* Understands the business vision from the data solutions and works with stakeholders to make it happen.
* Works alongside team members to drive towards the common goal.
* Responsible for providing innovative solutions that are best in class but also quick to market.
* Drive effective best practices across multiple initiatives.
* Collaborates with the Data Architects, enabling them to create data mapping documents that define the end-to-end pipelines or pipeline enhancements.
* Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target SQL database.
* Triages problems in the pipelines or data layers and effectively fixing them based on the priority.
* Automates data loading during initial or incremental loads.
* Is self-driven and can independently handle the work assigned.

Requirements:

* Solid programming skills and Python experience.
* Strong coding experience in Spark - primarily PySpark. Must be able to understand transformation requirements with ease and implement complex data processing algorithms in an efficient manner.
* Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
* Has worked on real data challenges and handled veracity, velocity and variability of data.
* Proficient with data warehousing and traditional ETL technologies.
* Strong experience in writing stored procedure, functions and triggers in SQL.
* Experience with pipeline testing (unit, integration, manual testing etc).
* Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.
* Excellent communication and stakeholder management skills

Good to haves:

* Knowledge on data analytics area using visualization and data modelling tools (such as PowerBI).
* Experience on Azure ecosystem and has worked with data management on Databricks, ADF, Blob Store, ADLS etc.
* Industry certification in Data Engineering is an added advantage.