Staff Quality Engineer — Qira AI Platform

We are Lenovo. We do what we say. We own what we do. We WOW our customers.
Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992) (ADR: LNVGY).
This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit www.lenovo.com (https://www.lenovo.com), and read about the latest news via our StoryHub (https://news.lenovo.com/).

About the Role

As a Staff AI Quality Engineer for the Qira AI Platform, you will lead the technical test strategy and architectural validation for Lenovo’s cross-device agentic AI ecosystem. You will serve as the technical authority on evaluating non-deterministic systems, designing automated quality platforms that operate across personal computing form factors (PCs, tablets, and smartphones). You will drive non-functional quality standards—ensuring that privacy, security, accessibility, internationalization, and device thermals/battery efficiency are safeguarded—while acting as a crucial release partner alongside Product Management and PMO leads.

What Will You Do

- Test Automation Architecture: Architect scalable, distributed, cross-platform test automation infrastructure capable of executing synchronized, multi-device end-to-end tests across Windows and Android devices without reliance on UI flakiness.

- Agentic AI Quality Frameworks: Design automated evaluation methodologies to validate multi-step agent reasoning, tool-calling graphs, autonomous error recovery, and transactional rollback mechanisms; establish statistical release gates for non-deterministic model behaviors.

- Hardware & Runtime Resource Profiling: Formulate automated performance and endurance soak suites to benchmark on-device SLM execution against cloud fallback paths, monitoring thermal throttling, memory leaks, and battery draw across hardware device tiers.

- Non-Functional Quality Standards: Lead automated verification across non-functional pillars: red-teaming indirect prompt injection vulnerabilities, securing inter-process data barriers, standardizing automated accessibility (screen-reader verbosity, dynamic token streaming), and validating semantic fidelity across international locales.

- CI/CD Quality Pipelines & Gating: Drive the technical implementation of shift-left gating in continuous integration pipelines, establishing automated failure analytics, regression detection, and flakiness isolation frameworks.

- Cross-Functional Peer Leadership: Serve as a core technical gatekeeper alongside Product Management and PMO; establish release acceptance criteria, lead data-informed risk assessments during schedule compressions, and influence platform design for enhanced testability.

Basic Qualifications

- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related technical field.

- 8+ years of progressive software quality engineering, test architecture, and automation experience covering multi-device hardware ecosystems (Windows and Android).

- 3+ years of experience leading quality strategy and automated evaluation frameworks for LLMs, agentic AI workflows, or conversational platforms.

- Advanced programming and architecture skills in Python, C++, C#, or Java, with a track record of building scalable test harnesses and mock environments for OS IPC, APIs, and background daemons.

- Proven experience architecting automated non-functional test frameworks: deep profiling of device performance (NPU/GPU/CPU, battery mA/h, memory), security red-teaming/prompt-injection defense, automated accessibility (WCAG), and i18n semantic evaluation.

- Deep technical expertise in CI/CD pipeline architecture, test orchestration, and statistical quality gating.

Preferred Qualifications

- Hands-on expertise implementing and tuning non-deterministic evaluation platforms (e.g., RAGAS, DeepEval, LangSmith, TruLens) in production pipelines.

- Direct experience testing local NPU runtimes and quantized models (INT4/INT8 vs. FP16) on client silicon (Qualcomm, Intel, AMD).

- Background designing automated testing for multimodal inputs (synchronized voice injection, screen-capture parsing, synthetic system events).

- Demonstrated ability to resolve complex release-gating disputes with Product Management and PMO using objective risk metrics and clear mitigation trade-offs.

NOTICE FOR PUBLIC
At Lenovo, we follow strict policies and legal compliance for our recruitment process, which includes role alignment, employment terms discussion, final selection and offer approval, and recording transactions in our internal system. Interviews may be conducted via audio, video, or in-person depending on the role, and you will always meet with an official Lenovo representative. Please beware of fraudulent recruiters posing as Lenovo representatives. They may request cash deposits or personal information. Always apply through official Lenovo channels and never share sensitive information. Lenovo does not solicit money or sensitive information from applicants and will not request payments for training or equipment. Kindly verify job offers through the official Lenovo careers page (https://jobs.lenovo.com/en_US/careers) or contact [email protected]. Stay informed and cautious to protect yourself from recruitment fraud. Report any suspicious activity to local authorities.