Share this job with your friends, family and co-workers...
THIS JOB ADVERT IS STILL ACTIVE...
DATA ENGINEER REF: SDE/ZR - 369525
DATA ENGINEER REF: SDE/ZR
Information Technology / Web Development / Telecommunications
Wage / Salary:
R - Market Related - P/M (Per Month)
Bellville, Western Cape
Data Engineer Ref: SDE/ZR
We are recruiting for a Data Engineer will be responsible for sourcing, loading and transforming a wide range of data across our business so that it can be used by analysts and developers to develop data solutions to business.
An understanding of data management solutions and a keen sense of the strategic value of information to an organisation will be of importance.
Permanent role,Cape Town
Assist the planning and management of the workload of the team and to ensure delivery
Act in technical capacity and design, develop and enhance the ingestion frameworks that can load data consistently with a high degree of confidence
Load large, complex data sets to and make data available for other data team members
Source data from internal and external data sources
Engaging with technical subject matter experts to understand data processes and creating delivery mechanisms that are in line with the initiative/project intent.
Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various ‘big data’ technologies
Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing models for greater scalability
Engage with a wide range of technical stakeholders including data scientists, business analysts, Tech Lead other data engineers and solutions architects
Work with data analysts and data engineers to understand the dynamic nature that is required to support the solution that needs to be built
Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes
Tailoring raw data to be able to consume and conform to the business requirement
Data acquisition from multiple data sources both internal and external to the business (e.g. web scrapping, online open source data, etc.)
Qualifications, Experience and Knowledge
National Diploma in an Information Technology related discipline or Bachelor’s Degree in Computer Science, Statistics, Informatics, Information Systems or any other quantitative field (preferred)
5 years' experience as a Data Engineer in a BI environment
Ability to comply to and manage data assets under a strict governance framework
Excellent SQL skills and development using SQL and procedural extensions is required.
Experience in ETL and data modelling toolsets (e.g. SAP Hana or SAP Data Services) is required
Strong Data Engineering background with a specific focus on staging high quality data
A solid background in SQL, Information Architecture and ETL procedures is required
Experience in Database design and technologies (e.g. SAP Hana, Cloudera or similar) or Hadoop components including HDFS, Hive, Spark, Oozie and Impala preferred Experience with object-oriented/functional/scripting languages (e.g. Python, R, Unix Shell scripting, Java, Scala etc.) is preferred but not essential.
Understanding of data warehousing principles (e.g. Kimball and Vault)
Experience in agile development methodologies
Experience with Power BI functionality