Staff Product Manager (Evals)

Responsibilities

• In this role, y ou will also be responsible to:
• Define and own the evaluation framework for Workato's internal AI agent features, driving adoption across teams starting with Agent Studio
• Build the customer-facing evaluation experience - how builders test, measure, and improve agents they create on Workato
• Make hard calls about what evaluation complexity to expose versus abstract, balancing rigor with approachability
• Partner closely with the Build Experience PM to ensure evaluation is integrated into the builder journey, not bolted on
• Work with ML engineers and platform teams to ground the framework in technical reality while keeping it accessible
• Establish metrics for what "good" looks like - both for internal agent quality and for customer evaluation adoption
• Spend significant time with customers understanding where they struggle to assess agent performance and what mental models they bring

Requirements

• Qualifications / Experience
• 7+ years in Product Management
• Hands-on experience writing evaluations for AI/ML systems (agents, LLMs, or similar)
• Track record of shipping technical products to both internal and external users
• Experience driving adoption of frameworks or practices across engineering teams
• Strong written and verbal communication skills
• Bachelor's degree or equivalent experience
• Strong product management experience. You've shipped products, driven roadmaps, and led cross-functional teams. You know how to translate technical capabilities into user value and write specs that don't leave details to chance.
• Technical translation ability. You can take complex evaluation concepts and make them accessible to business technologists without dumbing them down. You understand the difference between hiding complexity and organizing it.
• Internal influence skills. You've driven adoption of frameworks, practices, or tools across teams. You can be a credible partner to ML engineers while advocating for what internal teams actually need.
• Greenfield comfort. You've defined products from ambiguity - scoped v1s, made bets with incomplete information, and iterated based on

Benefits

Additional Information

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato's cloud-native architecture connects every application, data source, and process to power real-time orchestration at scale. With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business. To learn more, visit www.workato.com Why join us? Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles . We are driven by innovation and looking for team players who want to actively build our company. But, we also believe in balancing productivity with self-care . That's why we offer all of our employees a vibrant and dynamic work environment along with a multitude of benefits they can enjoy inside and outside of their work lives. If this sounds right up your alley, please submit an application. We look forward to getting to know you! Also, feel free to check out why: Business Insider named us an "enterprise startup to bet your career on" Forbes' Cloud 100 recognized us as one of the top 100 private cloud companies in the world Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company in the Bay Area, and 96th in North America Quartz ranked us the #1 best company for remote workers

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at workato? Share your experience