Data Engineer III - Paracon, Cape Town

  • Cape Town
  • Salary: Market Related (Negotiable)
  • Job Type: Permanent
  • Sectors: IT
  • Posted by Paracon on Thursday, March 26, 2020
  • Reference: 1120821
  • Apply before Thursday, April 23, 2020 - 21 Days left

Vacancy Details

Employer: Paracon

Large company who is currently the leader in their space, is seeking experienced Data Engineers to join their team. As a Data Engineer, you will build and support data pipelines and DataMart's built off those pipelines.

Both must be scalable repeatable and secure. This role functions as a core member of an agile team.

You will also be responsible for the infrastructure that provides insights from raw data, handling and integrating diverse sources of data seamlessly. Also enable solutions handling large volumes of data in batch and real-time leveraging emerging technologies from both the big data and cloud spaces.

For this role you will need substantial expertise in a broad range of software development and programming fields. As well as have knowledge of data analysis, end user requirements and business requirements analysis to develop a clear understanding of the business need and to incorporate these needs into a technical solution. You will also need to have a solid understanding of physical database design and the systems development lifecycle.

Objectives of the position include, but are not limited to, the following:

* Design and develop data feeds from the environment into a datalake environment in an AWS cloud environment

* Design and develop programmatic transformation, combinations and calculations to populate complex DataMart's based on feed from the datalake

* Provide operational support to DataMart datafeeds and DataMart's

* Design infrastructure required to develop and operate datalake data feeds

* Design infrastructure required to develop and operate DataMart's, their user interfaces and the feeds required to populated them

Experience required:

* Degree/Diploma (IT related)

* 4+ year's business intelligence experience

* 2+ year's creating data feeds from on-premise to AWS Cloud

* 2+ year's support data feeds in production on break fix basis

* 4+ year's creating data marts using Talend or similar ETL development tool

* 2+ year's manipulating data using Python and PySpark/Spark

* 2+ year's processing data using the Hadoop paradigm particularly using EMR, AWS's distribution of Hadoop

* 2+ year's Devop for Big Data and Business Intelligence including automated testing and deployment

Apply before Thursday, April 23, 2020 - 21 Days left Companies may expire jobs at their own discretion. If you have not received a response within two weeks, your application was most likely unsuccessful.
18 people have viewed this job.

Similar Jobs

More Paracon Jobs

About Paracon

Paracon SA is the founding company of the Paracon group of companies which provides Information and Communication Technology (ICT) services and solutions to a wide range of local and international clients. Paracon’s core business is its Resourcing division which is the leading supplier of ICT resources in South Africa, providing skilled ICT candidates for both consulting and permanent positions. The company also offers a complementary set of services which supports its core business, including consulting, project management and professional services.

We are a leader in Africa in the ICT resourcing and services industry.

Superior level of service is our pride, ensuring operational excellence in all facets of our business. We offer a complementary set of services to support your core IT business needs, including consulting, project management and professional services.

You can trust a leader to provide the best ICT people, services and solutions for your business.