🌿 Back to all jobs

🥝 Tech Lead

Yantran LLC | San Jose, California, United States | Posted May 08, 2026

Job Description

Design and run intelligent test strategies for LLM and agent based systems, combining classic QA and test automation skills with a deep understanding of agentic automation,and conversational AI,

Responsibilities

Design and execute end to end test plans for UX / Uber orchestrator/ Sub Agents . Build and maintain agentic AI test suites validating autonomous .

Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests.

Evaluate agent behavior through reasoning traces, tool use decisions, and memory usage.

Implement and improve automated testing frameworks leveraging AI

for conversational flows, APIs, and integrations.

Collaborate with Product management / cross functional teams to refine requirements and acceptance criteria.

Document defects, test results, and insights clearly for stakeholders.

Skill Set

Minimum 5 years of experience in software QA / test engineering...

Apply for This Position

Submit Application