Lead experimentation strategy across web, desktop, iOS, and Android digital products.
Design, execute, and scale advanced experimentation programs, including multivariate testing, holdout testing, sequential testing, and other sophisticated methodologies.
Partner with engineering, analytics, and AI/ML teams to ensure statistically sound experiment design, implementation, measurement, and interpretation.
Analyze experiment outcomes in depth by identifying trends, diagnosing anomalies, validating assumptions, and uncovering actionable business insights.
Develop and implement scalable experimentation frameworks, governance models, and best practices across multiple teams.
Review and optimize experiment design, execution processes, and reporting standards to improve testing effectiveness and reliability.
Translate experimentation results into clear product recommendations and business decisions that drive measurable outcomes.
Internal Responsibilities:
Attend regular internal practice community meetings.
Collaborate with your itD practice team on industry thought leadership.
Complete client case studies and learning material (blogs, media material).
Build out material to contribute to the Digital Transformation practice.
Attend internal itD networking events (in person and virtual).
Work with leadership on career fast-track opportunities.
Required Qualifications and Skills:
5+ years of experience in Product Management, Experimentation, Testing, or data-driven product roles.
Hands-on experience with enterprise experimentation platforms such as Adobe Target or comparable testing solutions.
Proven experience operating within high-volume, enterprise-scale experimentation environments.
Deep understanding of experimentation methodologies beyond basic A/B testing, including multivariate testing, holdout testing, and advanced experimental design.
Strong knowledge of statistical concepts including sample size determination, statistical significance, bias, variance, confidence intervals, and experiment validity.
Experience partnering with cross-functional teams including engineering, analytics, and data science organizations.
Demonstrated ability to perform detailed experiment analysis and translate findings into actionable product and business recommendations.
Preferred Qualifications and Skills:
Experience building, scaling, or governing enterprise experimentation frameworks and platforms.
Exposure to personalization systems, feature flagging platforms, or adaptive experimentation approaches.
Experience with server-side experimentation and backend-rendered application environments.
Experience supporting experimentation initiatives within large-scale technology, e-commerce, or digital consumer product organizations.
Familiarity with AI/ML-driven optimization and experimentation use cases.
Education:
Bachelor's degree in a relevant field or equivalent work experience required.
Company Description
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orien
Benefits
Dental insuranceVision insurance401(k)Remote work options
Additional Information
itD is seeking a Senior Product Manager - Testing to lead and scale enterprise experimentation capabilities across digital products, driving data-informed product decisions and advancing a mature culture of experimentation. This role will help establish best practices, improve experimentation rigor, and enable teams to leverage testing as a strategic product capability. The ideal candidate will bring deep experience in enterprise experimentation programs and a proven track record of delivering measurable business impact through advanced testing methodologies.
Location: Remote in US - must be able to work PST hours
Itd · San Francisco, CA