Data Engineer

International SOSOn-siteFull-timeMid level, 2–5 yearsListed 4 days ago

Apply now

About this role

The Role

The Data Engineer will design, develop and support secure, scalable backend applications using .NET Core, C#, the Microsoft technology stack and AWS cloud services. The role focuses on building reliable APIs, microservices and event-driven integrations using AWS services such as SNS, SQS, Lambda, EventBridge, API Gateway and managed data services.

- Analyze business and technical requirements for backend, API, cloud and integration solutions

- Design and develop .NET Core applications, REST APIs, microservices and reusable integration components

- Build AWS-based event-driven solutions using SNS, SQS, Lambda, EventBridge and API Gateway

- Apply asynchronous messaging, queue-based processing, retries, dead-letter queues and idempotency patterns

- Create and maintain technical documentation, API contracts, message schemas and operational support notes

- Collaborate with product, architecture, QA, DevOps/SRE, cloud platform and vendor teams

Responsibilities

- Design, develop, test and maintain backend applications using .NET Core, C#, ASP.NET Core Web APIs, Entity Framework Core and related Microsoft development frameworks.

- Build secure RESTful APIs and integration services with clear contracts, versioning, validation, authentication, authorization and effective error handling.

- Implement event-driven and asynchronous communication patterns using AWS SNS, SQS, Lambda and EventBridge, including publish/subscribe, queue-based processing, retries, dead-letter queues and message tracing.

- Support cloud-native workloads on AWS using services such as API Gateway, Lambda, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.

- Apply microservices, distributed systems, resiliency, observability, logging and monitoring practices to improve system reliability and supportability.

- Troubleshoot and resolve application, API, database, messaging and cloud infrastructure issues across development, test and production environments.

- Create technical specifications, solution notes, sequence diagrams, API contracts, event/message schemas and operational documentation.

- Support CI/CD, automated testing, code reviews, release activities and infrastructure as code using tools such as Git, Bitbucket, Jira, Confluence, Terraform, CloudFormation, Jenkins or GitHub Actions.

- Collaborate with product owners, business analysts, architects, QA, DevOps/SRE, cloud platform teams and third-party vendors to deliver high-quality solutions.

- Contribute to engineering standards, reusable patterns, documentation and continuous improvement across the development team.

Requirements

- Bachelor’s degree in Computer Science, Information Technology (or similar)

- 6-8 years of software development experience across design, development, testing, release and production support.

- Strong hands-on experience with .NET Core / .NET 6+, C#, ASP.NET Core, Web APIs, Entity Framework Core, LINQ, asynchronous programming and secure coding practices.

- Experience with the broader .NET and Microsoft stack, including Visual Studio, NuGet, dependency injection, configuration management, authentication/authorization, unit testing and diagnostics.

- Hands-on AWS development experience with SNS, SQS, Lambda, EventBridge, API Gateway, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.

- Practical knowledge of event-driven architecture, including publish/subscribe, queue-based processing, fan-out, dead-letter queues, retry policies, idempotency, correlation IDs and eventual consistency.

- Experience with microservices, REST APIs, OpenAPI/Swagger, JSON, XML, API-led integration and service-to-service communication.

- Working knowledge of SQL Server, PostgreSQL and NoSQL databases such as MongoDB or DynamoDB.

- Experience with Docker, Kubernetes/EKS, CI/CD, Git-based development, automated builds, deployment pipelines and infrastructure as code using Terraform or CloudFormation.

- Familiarity with engineering and testing tools such as Postman, JMeter, Swagger/OpenAPI, Jira, Confluence, Bitbucket and monitoring/logging platforms.

- Good understanding of unit testing, integration testing, contract testing, performance testing and test automation practices.

- Understanding of application security, secrets management, encryption, least-privilege access, OWASP principles and secure API design.

- Strong troubleshooting and analytical skills across application code, APIs, databases, queues, cloud services and deployment pipelines.

- Good communication, collaboration and documentation skills with the ability to explain technical concepts clearly.

- Ability to work effectively in Agile delivery teams and coordinate across product, architecture, engineering, QA, DevOps/SRE and vendor stakeholders.

- Organized, detail-oriented and able to manage multiple priorities in a dynamic environment.