Senior Data Engineer – 10 Yrs - Cape Town (Hybrid)

About the Opportunity

This is an exciting chance to join a forward-thinking organisation as a Senior Data Engineer, contributing significantly to the development and implementation of data-driven solutions. As part of a collaborative and innovative team, you will play a pivotal role in shaping how data is leveraged to achieve business objectives. The company is dedicated to technological advancement and offers a stimulating environment for professionals who are passionate about building robust and scalable data infrastructure. This role requires a seasoned individual with a minimum of ten years of experience in data engineering, coupled with a strong understanding of best practices and emerging trends in the field.

What You'll Be Doing

Your responsibilities will centre on the design, construction, and maintenance of sophisticated data pipelines and systems. This will involve working with large and complex datasets, ensuring data integrity, and optimising data flows for performance and reliability. You will be instrumental in developing and implementing data warehousing solutions, ETL/ELT processes, and data modelling strategies.

Key duties will include:

• Designing, building, and optimising scalable data pipelines for batch and real-time data processing.
• Developing and maintaining data models and database schemas to support analytical and operational needs.
• Implementing data quality checks and ensuring the accuracy and consistency of data across various sources.
• Collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and provide solutions.
• Troubleshooting and resolving issues related to data systems and pipelines.
• Staying abreast of new technologies and methodologies in data engineering and recommending their adoption where appropriate.
• Contributing to architectural decisions and technical design discussions.
• Ensuring the security and compliance of data handling processes.

What We're Looking For

We are seeking a highly experienced Senior Data Engineer with a proven track record of success in designing and implementing complex data solutions. A deep understanding of the entire data lifecycle, from ingestion to consumption, is essential. You should possess strong analytical and problem-solving skills, with the ability to translate business needs into technical data strategies.

To be considered for this role, you should have:

• A minimum of 10 years of professional experience in data engineering.
• Demonstrated expertise in designing, building, and optimising data pipelines and data warehouses.
• Proficiency in SQL and experience with various database technologies (e.g., relational databases, NoSQL databases).
• Solid programming skills in languages commonly used for data engineering, such as Python or Scala.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their associated data services.
• Familiarity with big data technologies and frameworks (e.g., Spark, Hadoop ecosystem).
• Knowledge of data modelling techniques and best practices.
• Experience with ETL/ELT tools and concepts.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• A degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

This hybrid role, based in Cape Town, offers a fantastic opportunity for a seasoned data professional to make a significant impact within a dynamic technology environment. In South Africa, senior data engineering roles typically command competitive salaries, reflecting the demand for specialised skills in this area. Employers range from established tech firms and financial institutions to innovative startups. Career progression often involves moving into lead engineering positions, data architecture roles, or management within data-focused departments.

• Bachelor's degree in Computer Science or related field.
• 2+ years of software development experience.
• Proficiency in programming languages such as Java, C#, or Python.
• Strong understanding of software development methodologies and practices.