Intermediate Data Engineer - Johannesburg (In office)

A prominent technology firm is on the hunt for a skilled Intermediate Data Engineer to join their Johannesburg-based operations. This is an exciting opportunity for a professional who is passionate about leveraging data to drive innovation and enhance customer experiences. The role is based in the office, fostering a collaborative and team-oriented work environment.

About the Role

This position is central to the company's mission of providing cutting-edge technological solutions that empower businesses globally. As an Intermediate Data Engineer, you will be instrumental in designing, building, and maintaining robust data systems. Your work will directly impact the company's ability to deliver exceptional products and services, ultimately contributing to sustained business success. You will be part of a forward-thinking organisation that values innovation and places a strong emphasis on professional development. This role offers a chance to work with complex datasets and apply advanced engineering principles to solve real-world challenges.

The day-to-day responsibilities of this Intermediate Data Engineer role are multifaceted and crucial to the organisation's data infrastructure. Key duties will include:

• Designing, developing, and maintaining high-quality, scalable data pipelines and systems.
• Collaborating closely with cross-functional teams, including software developers, data scientists, and business analysts, to understand data requirements and translate them into technical solutions.
• Implementing and optimising data warehousing solutions and data lakes to ensure efficient data storage and retrieval.
• Ensuring data integrity, accuracy, and security across all data platforms.
• Participating actively in code reviews, offering constructive feedback, and upholding software development best practices.
• Troubleshooting and debugging complex data-related issues to ensure smooth operation of data systems.
• Contributing to the continuous improvement of data engineering processes and methodologies.
• Exploring and implementing new technologies and tools to enhance data processing capabilities.

What They're Looking For

To excel in this role, candidates should possess a solid foundation in data engineering principles and practical experience. The ideal candidate will demonstrate a proactive approach to problem-solving and a commitment to delivering high-quality work. Essential qualifications and skills include:

• A tertiary qualification, such as a Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• A minimum of three years of professional experience in data engineering or a closely related software development role.
• Proficiency in one or more programming languages commonly used in data engineering, such as Python, Java, or Scala.
• Hands-on experience with SQL and relational databases.
• Familiarity with big data technologies and distributed systems (e.g., Spark, Hadoop).
• Experience working with cloud platforms (e.g., AWS, Azure, GCP) and their associated data services.
• Knowledge of data modelling techniques and data warehousing concepts.
• Experience with Agile development methodologies and version control systems (e.g., Git).
• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal abilities, with the capacity to collaborate effectively within a team environment.

In South Africa, the remuneration for an Intermediate Data Engineer can vary significantly based on experience, the specific industry, and the size and type of the organisation. However, roles at this level often command competitive salaries, reflecting the specialised skills required. Typical employers range from large established corporations in finance and telecommunications to dynamic tech startups and consultancies. Career progression in this field typically involves advancing to Senior Data Engineer, Lead Data Engineer, or specialising in areas like Machine Learning Engineering or Data Architecture.

• Bachelor's degree in Computer Science or related field.
• 3+ years of software development experience.
• Proficient in Java, Python, or C#.
• Experience with Agile development methodologies.