Data Engineer

The Data Engineer will be responsible for designing, implementing, and maintaining the data infrastructure necessary for our Insights team to analyze data and derive valuable insights. The Data Engineer will work with Engineering Leads, Data Architects and other stakeholders to ensure that our data is properly sourced, stored, and accessible for analysis. They will also contribute to our mission by extracting maximum predictive value from data assets.

- Must have at least 3 years of relevant IT experience or related qualification.
- 3+ years experience with Data pipeline design and development experience.
- Proficiency in Python and/or SQL.
- RDBMS experience in technology such as SQL Server, MySQL and PostgreSQL.
- Ability to use common scripting languages such as Powershell, Bash, or Python for automation.
- Experience using unit and integration tests.
- Experience working with production BI environments and tools such as PowerBI, Tableau or Pyramid Analytics.
- Strong analytical/problem solving skills.

Skills

- Databricks Certified Data Engineer Associate certification.
- Experience in Azure data technologies; a relevant Azure certification would be advantageous
- Hands-on experience with Azure DevOps, Git, CI/CD practices, Docker and containerization
- Exposure to .net entity framework.
- Exposure to Databricks, Delta Lake and PySpark.
- Experience with data streaming or distributed processing technologies such as Kafka or Hadoop.
- Experience delivering data projects in Retail, Finance, Customer or HR domains would be advantageous
- Experience mentoring junior engineers would be advantageous

Behaviours

- Manages Complexity - interprets and simplifies complex and contradictory information when resolving organisational problems
- Strategic Mindset - thinks and plans strategically, focusing on the long-term goals and objectives of the organisation
- Tech Savvy - leverages new technology to enhance productivity, improve problem solving, and support business growth
- Cultivates Innovation - creates an environment that fosters and nurtures a culture of creativity which drives success
- Drives Engagement - inspires, motivates and empowers individuals to go above and beyond for the benefit of the team and the organisation

Preference will be given but not limited to candidates from designated groups in terms of the Employment Equity Act.