Lead the AI Quality engineering team while building evaluation infrastructure, CI/CD pipelines, scorers, datasets, observability tools, and diagnostic systems for production AI agents. Run experiments across prompts, models, routing, caching, and agent orchestration to improve quality, latency, and cost. Manage team priorities, remain hands-on in development, and partner with AI Core engineering to validate product improvements.