Job description

The Senior Quality Engineer II (AI & Data) role is responsible for defining and executing the quality strategy for AI-driven products, operating at the intersection of data engineering and frontend application development. The position ensures machine learning models reliability, data pipeline accuracy, and seamless end-user experience across AI-powered systems. The role involves validating data ingestion and transformation processes to ensure high-quality datasets for model training, conducting deep API testing using APIDog to validate model responses and handling complex edge cases including zero-value parameters and unauthorized access. The position requires implementing evaluation frameworks for generative AI outputs measuring relevance, factual accuracy, coherence, and hallucination rate using techniques such as LLM-as-a-judge, human-in-the-loop scoring, and automated benchmark suites. The role also includes designing test strategies for AI agent responses including tool-call accuracy, multi-step reasoning integrity, goal completion rate, and graceful failure handling for adversarial inputs and out-of-scope scenarios. The position requires proactive security testing including identification of vulnerabilities such as request interception, price manipulation, prompt injection, and jailbreak attempts specific to generative AI surfaces. The role involves building and maintaining UI automation suites using low-code tools such as mabl while aiming for high Mabl Test Coverage percentage. The Senior Quality Engineer II will advocate for AI tooling including Jira Rovo for requirement analysis and automated test case generation to improve team velocity. Additionally, the role involves leading Root Cause Analysis for production bugs and developer-rejected tickets, continuously improving Definition of Done, and ensuring product quality across AI-driven e-commerce customer flows. The position requires strong SQL proficiency, automation expertise using Selenium, mabl, and Playwright, experience testing data-heavy applications or machine learning models, understanding of OWASP security principles, and experience in e-commerce and critical customer-flow analysis. The role is based in Makkah, Saudi Arabia, operating under a hybrid work arrangement within a technology and AI-focused quality engineering team.