QA Automation Engineer - AI Labs

Job Requirements

Role/ Job Title: Generative AI (GenAI) Senior QA Engineer

Business: Data & Analytics

Function/ Department:Data & Analytics

Job Purpose :

'Design and execute comprehensive test strategies and plans for GenAI applications, APIs, and RAG systems.

Demonstrate strong reasoning and analytical skills in test planning, coverage analysis, and defect triaging.

Perform functional, regression, integration, performance, and exploratory testing across AI workflows.

Implement modular automation frameworks for scalability, maintainability and Reduce manual effort

Validate model responses for accuracy, consistency, relevance, bias, and ethical compliance.

Create and maintain detailed documentation, including test plans, test cases, test results, and QA reports.

Collaborate with cross-functional teams to define test coverage, acceptance criteria, and performance benchmarks.

Own the quality lifecycle from test planning to defect triaging and production validation.

Continuously improve QA processes, tools, and automation frameworks.

Stay updated with emerging QA tools, GenAI testing techniques, and industry best practices.

Roles & Responsibilities:

'Develop and maintain automated test suites for UI, API, and performance testing.

Lead end-to-end testing of GenAI workflows.

Implement modular automation frameworks for scalability, maintainability and Reduce manual effort

Define and enforce QA standards, test coverage metrics, and release quality gates.

Take complete ownership of new QA initiatives, from requirement analysis to production validation.

Collaborate with developers and product teams to identify edge cases and failure scenarios.

Conduct load, stresstesting for critical APIs and services.

Mentor junior QA engineers and contribute to test strategy discussions.

Drive defect triaging, RCA, and continuous improvement initiatives.

Secondary Responsibilities :

Conduct exploratory testing and usability validation.

Maintain test documentation, and release notes.

Evaluate and onboard new testing tools and frameworks.

Facilitate UAT, production smoke testing, and post-release validation to ensure high product reliability

Managerial & Leadership Responsibilities:

Conduct exploratory testing and usability validation.

Maintain test documentation, and release notes.

Evaluate and onboard new testing tools and frameworks.

Facilitate UAT, production smoke testing, and post-release validation to ensure high product reliability

Qualifications:

B.Tech/MCA

Years of Experience:

1+ Years of Experience preferred