Data Engineer

At OUTsurance, a prominent player in the South African insurance sector, a compelling opportunity exists for a skilled Data Engineer to join their expanding team in Centurion. If you possess a deep-seated passion for all things data and thrive on crafting robust, high-performance data solutions, this role might be precisely what you're seeking. The company is on the lookout for an individual who can tackle the technical complexities of their data ecosystem, viewing it as an exciting challenge to architect optimised processes. The ideal candidate will be adept at building reusable, high-quality datasets that serve a diverse range of analytical needs across the organisation.

About the Role

This Data Engineer position is central to OUTsurance's commitment to leveraging data for innovation and improved service delivery. You will be instrumental in shaping the company's data landscape by developing and implementing best practices and architectural patterns. This involves diligently maintaining current data workloads, optimising data warehouse configurations, streamlining data pipelines, and enhancing existing data products. The role demands a proactive approach to problem-solving and a keen eye for efficiency, ensuring that data processing is not only fast but also reliable and accurate.

Your responsibilities will extend to supporting a variety of internal stakeholders, including software development teams, actuarial specialists, payroll departments, and finance analytics units. Your expertise will be crucial in enabling these teams to access and utilise data effectively for their respective functions. Furthermore, you'll contribute to the team's broader objectives of designing and building highly available, scalable, and fault-tolerant data infrastructure. This includes developing and maintaining infrastructure automation tools, deployment pipelines, and robust monitoring systems, all while fostering strong collaborative relationships with fellow engineers, data scientists, and analysts to ensure optimal performance and availability of the data infrastructure.

The day-to-day contributions of a Data Engineer in this role are multifaceted, focusing on the design, development, and maintenance of critical data infrastructure. Key duties include:

• Designing, building, and maintaining scalable and reliable data pipelines capable of processing substantial volumes of data sourced from diverse origins.
• Developing and maintaining data models, databases, and data warehouses to effectively meet the reporting and analytical requirements of various teams.
• Implementing rigorous data validation and monitoring processes to uphold data quality and accuracy.
• Collaborating closely with data scientists, analysts, and other stakeholders to thoroughly understand their data requirements and deliver effective solutions.
• Contributing to the evaluation of new data technologies and tools, aiming to enhance the performance and reliability of the data infrastructure.
• Driving the adoption of these new technologies and best practices within the wider data community at OUTsurance.
• Creating and promoting best practice "formulas" that align with OUTsurance's overarching data strategy.

What They're Looking For

OUTsurance is seeking a candidate who not only possesses strong technical acumen but also aligns with their core company values of Awesome Service, Dynamic, Honest, Human, Passionate, and Recognition. The ideal candidate will demonstrate:

• A solid understanding and practical application of industry best practices in data engineering.
• The ability to provide input into innovative solutions that drive technological advancement.
• Proficiency in at least one programming language such as Python or C#, along with strong SQL skills.
• Proven experience in data modelling, ETL processes, and data warehousing.
• Demonstrable experience with cloud platforms, with a preference for Azure, and familiarity with services like Azure Data Lake Storage, Cosmos DB, Databricks, and Apache Airflow.
• An understanding of data processing technologies, data management principles, and modern data architectures.
• Familiarity with technologies such as SQL Server, SSRS, SSAS, and Power BI for on-premise solutions is also beneficial.
• Excellent written and verbal communication skills, with the capability to articulate complex technical concepts clearly and effectively.
• The ability to work effectively under pressure and meet tight deadlines.
• A self-motivated and proactive mindset, with the capacity to work independently and as part of a collaborative team.

This role presents an excellent opportunity for a seasoned Data Engineer to contribute to a forward-thinking insurance company that values innovation alongside its human-centric culture. For those seeking to advance their careers in a dynamic environment, this position within OUTsurance offers significant potential for growth and impact.

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or related fields.
• Proficiency in at least one programming language (Python, C#, etc.) and SQL.
• Proven experience with data modelling, ETL processes, and data warehousing.
• Experience with cloud platforms such as AWS, GCP, or Azure
• Understanding of data processing technologies and data management principles
• Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow