About this role
About the Role"
We are looking for a skilled AI Test Engineer with expertise in AI evaluation areas and Android platform testing. The ideal candidate will have a strong understanding of software testing practices and the ability to collaborate effectively with development teams.
"Job Title"
AI Test Engineer
"Responsibilities"
- Evaluate AI performance in areas such as answer relevancy, task completion, correctness, hallucination detection, and tool correctness.
- Conduct testing on Android platform and applications using relevant tools.
- Test application memory, performance, and battery usage across Android environments.
- Follow the Software Testing Life Cycle (STLC) to ensure thorough testing.
- Implement AI safety and security testing practices.
- Collaborate closely with development teams and leads.
- Review Module-specific HLD/PRD documents and create test strategies, plans, and detailed test cases.
- Develop automation tests using tools like Python, PyWinAuto, Selenium, and Playwright.
- Foster effective cross-team collaboration.
- Mentor and guide junior engineers.
"Required Skills"
- Strong expertise in AI evaluation areas.
- Extensive experience in Android platform and application testing.
- Deep knowledge of application memory, performance, and battery testing.
- Understanding of the Software Testing Life Cycle (STLC).
- Basic knowledge of AI safety and security testing.
- Hands-on experience with development teams.
- Ability to translate requirements into test strategies and plans.
- Experience in automation testing using Python, PyWinAuto, Selenium, and Playwright.
- Demonstrated cross-team collaboration skills.
- Ability to mentor junior engineers.
"Desirable Skills"
- Certification in software testing or related field.
- Familiarity with other automation testing tools and frameworks.
"Education Qualification"
- Bachelor's degree in Computer Science, Engineering, or related field.