Quality Engineer Specialist – AI & LLM Solutions

We are looking for a QA Engineer Specialist specializing in AI and LLM-based systems to ensure the quality, reliability, and performance of AI products used across global media and marketing platforms. The role focuses on testing LLMs, RAG pipelines, AI agents, and ML/data workflows , with a strong emphasis on automation and AI-specific quality metrics .

Key Responsibilities

• Own quality assurance for AI products , including LLMs, RAG systems, agents, and ML pipelines.
• Design and execute AI-specific test strategies (factuality, hallucinations, robustness, safety).
• Validate agent behaviors , AI outputs, and performance (latency, stability, quality).
• Build and maintain automated test suites integrated into CI/CD pipelines.
• Prevent regressions and assess the impact of model, embedding, ...