Essential Skills Proven experience building and optimizing data pipelines and big data solutions Strong programming skills in Python (or similar) Experience with cloud data platforms (Azure, AWS, or GCP) Solid understanding of data governance, quality, and compliance Hands-on experience with CI/CD and workflow orchestration tools Strong analytical, problem-solving, and strategic thinking skills Ability to lead, collaborate, and influence in cross-functional teams Role & Responsibilities Design, develop, and deliver scalable data engineering solutions using Python or similar languages Build and optimize data pipelines and data models using modern frameworks (e.g., Spark, Flink) Collaborate with stakeholders to clarify requirements and refine user stories Participate actively in Agile ceremonies (planning, refinement, retrospectives) Implement CI/CD pipelines and DevOps practices for data workflows Ensure data quality, governance, lineage, and compliance across systems Provide support and maintenance of existing data solutions Drive continuous improvement , innovation, and solution prototyping Lead knowledge sharing, mentoring, and coaching within the team Advantageous Skills Experience with streaming platforms (Kafka, RabbitMQ, MQTT) Exposure to serverless architectures and cloud-native services Familiarity with monitoring and logging tools (Splunk, ELK, Azure Data Explorer) Basic frontend knowledge (React, Vue.js) Experience supporting production environments and ticket management Strong business acumen and ability to translate requirements into solutions Experience working in distributed/global teams Agile methodology and ITIL knowledge Willingness to travel internationally when required QualificationsBachelors or Masters degree in Computer Science, Data Engineering, Information Systems , or related field Minimum 5+ years experience in data engineering within complex environments Proven experience delivering cloud-based data solutions Relevant cloud certifications are advantageous but not required
Data Engineer (Senior) 0641
OPEN SOURCE (PTY) LTD
menlyn, menlyn
Published 15 days ago
Report job