Software & Data Engineer – Banking (CIB)

Resource Requirements

Company: BluePearl Consulting
Number of Vacancies: 1
Industry: Banking / Financial Services
Department: Corporate and Investment Banking (CIB)
Contract Duration: 12 months, with potential extension up to 36 months
Expected Start Date: 1 January 2027
Location: Rosebank, Johannesburg, Gauteng
Work Arrangement: Hybrid – approximately 3 days onsite per week

Job Summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment.

This role requires a combination of software engineering and data engineering expertise. The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development lifecycle.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, knowledge of ETL/ELT processes and experience with automated testing, CI/CD, monitoring and production support.

The candidate must be a self-starter who can work independently, take ownership of technical deliverables and communicate effectively with technical and business stakeholders.

Key Responsibilities

- Design, develop and maintain software components and data engineering solutions.
- Build scalable data ingestion, transformation and integration pipelines.
- Develop reusable, maintainable and testable Python modules and services.
- Write, optimise and troubleshoot SQL queries.
- Apply software engineering principles, coding standards and appropriate design practices.
- Work with AWS cloud services to develop and support data-intensive applications.
- Develop and maintain ETL/ELT workflows and data processing components.
- Build and support APIs, integrations and event-driven components where required.
- Implement automated unit, integration, regression and reconciliation testing.
- Contribute to Git-based version control and CI/CD pipelines.
- Support automated deployment, quality gates and release processes.
- Work with distributed processing and event-streaming technologies where required.
- Implement logging, monitoring, alerting and operational support mechanisms.
- Troubleshoot application and data pipeline incidents and conduct root-cause analysis.
- Apply security, access control, encryption and data privacy practices.
- Maintain technical documentation, solution designs and operational runbooks.
- Collaborate with Data Engineers, Software Engineers and business stakeholders.
- Contribute to technical reviews, solution design and continuous improvement.

Requirements

Non-Negotiable Requirements

- Relevant banking or financial services experience.
- Demonstrable software engineering experience combined with Data Engineering capability.
- Strong Python engineering skills, including reusable modules, libraries and testing.
- Advanced SQL skills, including CTEs, window functions, query plans and optimisation.
- Practical ETL/ELT, data ingestion and transformation experience.
- Hands-on cloud engineering experience, with AWS as the core platform requirement.
- Experience with Git, CI/CD pipelines and automated deployments.
- Knowledge of automated testing, production monitoring and incident troubleshooting.
- Understanding of data quality, reconciliation, security and privacy controls.
- Strong problem-solving and technical documentation skills.
- Ability to work independently and take ownership of technical deliverables.
- Excellent communication and stakeholder management skills.
- Availability to work onsite in Rosebank approximately 3 days per week.
- Availability to commence on 1 January 2027.

Core Technical Skills

- AWS
- Python and software development
- Advanced SQL
- ETL/ELT and data pipeline development
- Data integration
- Git and CI/CD
- Automated testing
- Cloud-based processing
- Monitoring, logging and production support
- Data quality and reconciliation

Role-Critical Technologies

- AWS S3, Glue, Lambda, Athena, Redshift and EMR.
- Serverless processing and cloud-native engineering.
- Spark and PySpark.
- Kafka and event-driven processing.
- SQS, SNS and EventBridge.
- Airflow/MWAA and Step Functions.
- APIs and software-to-data integrations.
- Data warehouses, data lakes and lakehouse architectures.
- Terraform and Infrastructure as Code.
- Automated deployment and operational resilience.
- Performance tuning, monitoring and production readiness.

Desirable Capabilities

- Experience with batch processing and workflow scheduling.
- Data governance, ownership and classification.
- Cloud cost optimisation and FinOps awareness.
- Legacy system modernisation and cloud migration.
- Data products, interfaces and service-level agreements/objectives.
- Data mesh concepts and federated governance.

Core Attributes

- Strong banking or financial services awareness.
- Combines software engineering discipline with data engineering capability.
- Self-starter who works effectively with minimal supervision.
- Takes ownership of code, pipelines, deployments and deliverables.
- Proactive problem-solver with strong analytical skills.
- Excellent written and verbal communication.
- Strong attention to detail, reliability and quality.
- Effective collaboration with technical and business stakeholders.
- Professional stakeholder engagement.
- Smart and professional presentation appropriate to a banking environment.

Recruitment priority: A strong hybrid Software & Data Engineer who combines practical software development skills with data pipeline engineering, AWS expertise, sound testing and deployment practices, and relevant banking experience.