Data Engineer REMOTE
Role: Consultant
Client: United Nations organization via IdealStaffs Consulting
Contract type: Freelancer / Self-Employed / B2B only
Remote: Yes in CET /GMT time zone
Start date: ASAP
To apply for this position, you can send your resume at office@idealstaffs.com referencing the job title.
Description:
IdealStaffs Consulting is looking for an Data Engineer specialized to address the needs of associated activities to ensure the smooth operation of the current data pipelines and cloud infrastructure as well as incremental work to support new projects and proofs of concept.
Duties and resposabilities:
The data engineer will be expected to:
Deliver data engineering solutions supporting online platform analytics and data science projects.
Incorporate new data sets in the data lake using data integration technologies.
Enable the integration of external data sets based on available formats providing prompt turnaround of user requests including clear guidance on the automation of refreshes or, when not possible, details of the steps required by the user to trigger refreshes
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure technologies.
Model the data to produce comprehensive data models for use by non-IT data analysts
Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
Work with stakeholders including ICT to assist with data-related technical issues and support their data infrastructure needs.
Keep the data separated and secure in the data lake based on confidentiality
Provide the necessary data for monitoring of the availability of data, successfully daily operations and cost management
Document technical solutions and design
Work closely with the ICT team for all matters relating to data
Professional requirements:
A minimum of five years of progressively responsible experience in applied analytics, business intelligence, information management or statistics
Experience in mid to expert level programming capabilities in Spark, Python or Scala is required.
Experience on Azure cloud including Data Factory, Databricks, Data lake Storage is highly required.
Demonstrated experience in modern API platform design is required.
Experience in tools managing version control such as Git is highly required.
Experience with data warehousing, database programing languages like SQL, PL/SQL and noSQL databases like Cassandra or MongoDB is required.
Demonstrable knowledge of data analysis life cycle from ingest and wrangling to analysis and visualization to present findings.
Experience with development tools like IntelliJ/Eclipse/VSCode IDE, Build Tool Maven is required.
Experience working with analytical tools like Tableau, Qlik, PowerBI for semantic-layer-based data discovery is desirable.
Strong analytic skills related to working with unstructured datasets.
Excellent problem solving and troubleshooting skills.
Ability to convey complex / difficult data science topics to clients in a relatable manner.
Required competencies:
Problem solver – you can propose solutions in a clear and understandable manner to non-technical users. Ability to work with other to brain storm and develop practical and innovative solution
Team Worker - you develop and maintain a positive relationship with end users; able to consult and deal effectively with all levels of the organization and establish working relations of openness and trust in a multicultural setting. Work closely with the ICT technical team in all matters related to data.
Planner and Organiser – you prioritize and organize the work for effective resolutions of functional and technical problems
Performer – you demonstrate success in the implementation and quality control of corporate projects
Accountability: Takes ownership of all responsibilities and honours commitments; delivers outputs within prescribed time, cost and quality standards; operates in compliance with organizational regulations and rules
Education:
Advanced university degree (Master’s degree or equivalent) in computer science, data science, analytics, statistics, information management, public administration, management or a related field.
A first-level university degree in combination with qualifying experience may be accepted in lieu of the advanced university degree.
Languages
Excellent written and verbal communication skills in English essential.
To apply for this position, you can send your resume at office@idealstaffs.com referencing the job title.