Teams at Pencil

Own Pencil’s Evals & Quality product charter, including creative-quality metrics, judging rubrics, human-review processes, golden datasets, and scalable evaluation loops. Lead adevals.ai as a product, provide quality evidence for commercial work, define client-specific quality standards, and manage the full product lifecycle from discovery through post-launch audits. Success is measured through first-pass-right quality, evaluation coverage, judge-human calibration, dataset health, commercial adoption, and learning velocity.

Own delivery of a media-focused SaaS product from contractual scope through pilot launch. Responsibilities include building and sequencing the backlog, writing acceptance criteria, coordinating engineering and external API dependencies, managing milestone risks, overseeing MVP design, and preparing enterprise-client onboarding, operator playbooks, and measurement plans. The role requires strong paid media or ad-tech expertise and product management experience with technical platforms, APIs, data, or AI products.

Conduct end-to-end product research for a generative AI SaaS platform, including participant recruitment, interviews, usability testing, diary studies, surveys, and RITE testing. Translate client feedback into actionable product insights and requirements, collaborate with product managers and engineers, improve research operations, and manage relationships with engaged superusers. Communicate findings through compelling storytelling and demonstrate how research influences product decisions, feature adoption, and client satisfaction.