QA Lead — AI Systems & Models Testing

Contract • Montreal, QC • AI / ML Testing • LLM / RAG / LangChain

About the Role

We are seeking an experienced QA Lead with deep expertise in AI systems testing to join our team on a contract basis in Montreal, Québec. This role sits at the intersection of quality engineering and artificial intelligence, requiring hands‑on proficiency in LLM behavior analysis, RAG pipeline validation, and modern AI orchestration frameworks. You will own the end‑to‑end test strategy for complex AI products and help define quality standards in a rapidly evolving space.

MUST-HAVE SKILLS

• Proven QA leadership experience designing and executing test strategies for AI/ML systems or LLM-powered applications.
• Strong understanding of LLM internals: tokenization, embeddings, attention mechanisms, and inference behavior to anticipate and diagnose failure modes.
• Hands‑on experience with prompt e...