Vacancy Details
Employer: Jordan Human Resources
ESSENTIAL SKILLS:
- Expertise with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and SQL
- Strong programming skills in Python for data processing
- Experience with cloud data platforms (Azure) and their Databricks offerings; familiarity with object storage (ADLS)
- Proficient in building and maintaining ETL/ELT pipelines, data modeling, and performance optimization
- Knowledge of data governance, data quality, and data lineage concepts
- Experience with CI/CD for data pipelines, and orchestration tools (GitHub Actions, Asset Bundles or Databricks’ jobs)
- Strong problem-solving skills, attention to detail, and ability to work in a collaborative, cross-functional team
ADVANTAGEOUS SKILLS:
- Experience with streaming data (Structured Streaming, Kafka, Delta Live Tables).
- Familiarity with materialized views, streaming tables, data catalogs and metadata management.
- Knowledge of data visualization and BI tools (Splunk, Power BI, Grafana).
- Experience with data security frameworks and compliance standards relevant to the industry.
- Certifications in Databricks or cloud provider platforms.
QUALIFICATIONS/EXPERIENCE:
Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
3+ years of hands-on data engineering experience.
Key Responsibilities:
- Design, develop, test, and maintain robust data pipelines and ETL/ELT processes on Databricks (Delta Lake, Spark, SQL, Python/Scala/SQL notebooks)
- Architect scalable data models and data vault/ dimensional schemas to support reporting, BI, and advanced analytics
- Implement data quality, lineage, and governance practices; monitor data quality metrics and resolve data issues proactively
- Collaborate with Data Platform Engineers to optimize cluster configuration, performance tuning, and cost management in cloud environments (Azure Databricks)
- Build and maintain data ingestion from multiple sources (RDBMS, SaaS apps, files, streaming queues) using modern data engineering patterns (CDC, event-driven pipelines, change streams, Lakeflow Declarative Pipelines)
- Ensure data security and compliance (encryption, access controls) in all data pipelines
- Develop and maintain CI/CD pipelines for data workflows; implement versioning, testing, and automated deployments
398 people have viewed this job.
About Jordan Human Resources
We’ve been building better teams since 2004 with operating offices in Gauteng and
Cape Town, and since 2019 extended our reach with an active international footprint.
In September 2019, Vinton Holdings (Pty) Ltd acquired and became the proud owner of JorDan Human Resources.
Trusted by globally-recognised companies within the medical locum, perm and temporary markets, our flexible approach and network of legendary individuals continues to create real impact and help solve your business challenges. Fortunately, you don't have to wonder where to hire Phlebotomists, Medical Technologists, Registered Nurses & Enrolled Nurses anymore.
JorDan HR is the premier medical staffing agency for registered health professionals.
Whatever the problem, we’re part of the solution. The goal is to develop customised approaches that fit. Period.
Our size is our strength. We’re small enough to care but big enough to make an impact.
Genuine passion and enthusiasm for what we do, combined with a no bull attitude and a deep understanding of our sectors enable us to respond and adapt swiftly to clients’ needs.
Our group mission is to enhance our candidates’ lives as well as contributing positively to our clients‘ bottom line. Our established international footprint offers dedicated personal service, strong relationship building, ethical business practices, networking and professional search and recruitment, adding value within our chosen specialty industries.
Our home in Africa and our deep roots in the African People Management field gives us the ability to provide Key Insights and Actionable Market Intelligence to leading organizations wishing to enter the African market or expand their reach in Africa.
Compliance at its best. With continuous improvement in compliance and vetting procedures, JorDan HR, together with our independent verification partners, offer you peace of mind that is unmatched by competitors.
We move, connect, hustle, and stay humble.
You should work with us. Period.
More Jobs at Jordan Human Resources
German Speaking - Universal Agent - Remote
- East Rand
- Job Type: Permanent
- Posted 02 Dec 2025 | 4 Days left
Transaction Support Specialist (Finance and Billing)
- East Rand
- Job Type: Permanent
- Posted 02 Dec 2025 | 18 Days left
Remote Bilingual Phone Interpretor - English / French
- East Rand
- Job Type: Permanent
- Posted 02 Dec 2025 | 26 Days left
Remote Bilingual Phone Interpretor - English / Portuguese
- East Rand
- Job Type: Permanent
- Posted 02 Dec 2025 | 27 Days left