Key Responsibilities: - Build, optimise, and maintain scalable data pipelines using Databricks and Apache Spark- Design and implement end-to-end data workflows and CI/CD processes- Collaborate with cross-functional teams to deliver high-quality data solutions- Ensure data quality, reliability, and performance across pipelines- Contribute to architecture decisions and continuously improve existing systemsJob Experience and Skills Required: Education: - Relevant tertiary qualification in IT, Computer Science, Data Engineering, or related fieldExperience: - 35 years experience in data engineering- Proven experience working with Databricks and big data tools- Strong experience with Apache Spark and cluster computing- Background in backend development with solid software engineering fundamentals- Experience building and maintaining CI/CD pipelines- Exposure to Azure cloud services and infrastructure- Experience working with Medallion Architecture and/or Microsoft Fabric- Must have experience building robust, production-grade pipelines (not just maintenance)Skills: - Strong Python (including PySpark) and SQL experience- Solid understanding of end-to-end data flow design- Strong attention to detail with a focus on data quality- Excellent communication and collaboration skills- Familiarity with Agile methodologies- Growth mindset with the ability to continuously learn and apply new technologiesApply now!