Share this job with your friends, family and co-workers...
THIS JOB ADVERT IS STILL ACTIVE...
BIG DATA ENGINEER - 364039
BIG DATA ENGINEER
Information Technology / Web Development / Telecommunications
Wage / Salary:
R - Market Related - P/M (Per Month)
We are looking for a Senior Big Data Developer for a 12 months contract with a possibility being extended, to join an international company to work from home.
Duties & Responsibilities
KNOWLEDGE AND QUALIFICATION:
· Degree in computer science or a similar field
· 5+ years’ work experience in big data engineering
· Experience in using SQL to analyse data in a data lake, database or data warehouse and be able to use a major programming, preferably Python (PySpark) to process data at a massive scale
· Experience working with a wide range of big data tools, specifically Spark on AWS
· Experience with processing large datasets with Spark on AWS
· Experience with Drools (preferably in conjunction with Spark)
· Experience in data modelling, ETL development, and Data warehousing
· Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
· Experience developing software projects
· Experience using Linux/UNIX to process large data sets
· Combination of deep technical skills and business savvy enough to interface with all levels and disciplines within our clients’ organization
· Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment
Please note: If you haven’t heard from us in 2 weeks please consider your application unsuccessful