Azure Data Engineer (JB881) Location: Sandton, Johannesburg Salary: R900 000 per annum
We are currently sourcing an experienced Azure Data Engineer to join a growing team in Sandton. The candidate will be responsible for expanding and optimising data and data pipeline architecture within the Microsoft Azure platform, as well as optimising data flow and collection from various data sources and systems. They will support various data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. The candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
The Azure Data Engineer will be responsible for data-related implementation tasks that include provisioning data storage services, ingesting streaming, and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, optimizing data solutions and accessing external data.
Additionally, you will be responsible for designing solutions for business which conforms to best practises in terms of planning, design, security, structure, redundancy and availability, including monitoring and alerting Key responsibilities:
Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure big data technologies.
Work with various project stakeholders throughout the project lifecycle.
Work with data and analytics experts to strive for greater functionality in our data systems
Similar work experience at large corporate
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
Kontak Recruitment is a Pastel Certified Recruiter which specializes in the recruitment of personnel on all career levels including the placement of temporary, contract as well as permanent staffing. We enjoy the personalized approach with regards to out candidates focusing on their needs and requirements as well as a personalized approach with our clients in delivering an excellent service.
Kontak Recruitment conducts business in an ethical and honest manner. We aim at building long term relationships that are to the mutual benefit of all parties. We offer a responsible and personalized service to clients and candidates. We encourage an employment environment that provides equal opportunities for all employees. All positions and applications remain confidential protecting the rights and interests of both the client and the candidates.
Our core focus is delivering a staffing solution in the niche fields of Pastel Consultants,finance as well as office support. As part of this service offering we include extensive reference and qualification checks as well as a criminal and credit check. Our focus is quality and we will present the most efficient and integrated ways of satisfying the skills need within the company.
Permanent staff placements – We strive to find the right fit and providing support to client and candidate during the first three months of the employment.
Temporary and Contract placements – We offer immediate access to staff on all levels on a flexible basis. Kontak Recruitment administers the payroll and all statutory returns.