Assessment Solution Strategist

Responsibilities

• Blueprint to delivery | Design assessment blueprints, generate item prompts, develop items across the full complexity spectrum, and manage forms from creation through continuous improvement.
• Performance monitoring & analytics | Run item and test analyses, calibration, equating, scaling, and reliability/validity checks. Flag issues, investigate root causes, and drive continuous improvement across the assessment portfolio.
• Standards, content guidelines & QA | Contribute to assessment content standards and ensure the portfolio aligns to curriculum and learning objectives. Apply item-level QA with a sharp editorial eye and advise on evidence-based assessment practices.
• Vendor & partner relationships | Lead day-to-day collaboration with SMEs and vendors, support SOW execution, and manage multiple concurrent projects to deadline - independently and without hand-holding.
• Documentation & process ownership | Author and maintain processes, procedures, and decisions related to assessment design, development, and continuous quality monitoring. Resolve complex queries from internal partners and escalate where appropriate.
• EXPERIENCE YOU'LL BRING
• Bachelor's degree in educational or psychological measurement, instructional design, psychometrics, or a related field
• 3+ years of relevant professional experience designing and developing high-integrity assessments
• Strong command of assessment types, taxonomy, and principles of validity and reliability
• Excellent writing, editing, and quality assurance skills
• Experience working with vendors, SMEs, and cross-functional teams
• Proficiency with learning management systems, authoring tools, and item banks
• Strong organizational and project management skills with the ability to manage multiple projects simultaneously
• Strong analytical skills and a data-driven approach to decision making
• Exceptional attention to detail

Requirements

• Master's degree or 3-5 years of specialized experience in assessment design, development, or measurement
• Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security)
• Background in psychometrics or data analysis using tools like Excel, R, or SPSS
• Knowledge of accessibility and Universal Design for Learning (UDL) standards
• Experience with adaptive testing or automated assessment tools
• Familiarity with the Pluralsight platform and value proposition
• Experience with SaaS software (e.g., ZenDesk, Asana, Confluence, Smartsheet)
• Why you'll love working here:
• We work in a blended environment that supports collaboration, flexibility, and connection across teams.
• We are mission-driven, shaping the future of tech upskillling and delivering impact that matters.
• We foster a culture of inclusion and belonging, where everyone can contribute and thrive.
• We are always learning, creatin

Benefits

Additional Information

Job Description: Assessments are only as powerful as the thinking behind them. At Pluralsight, we believe that measuring skills well is one of the most meaningful things you can do for a technologist's career - and we're looking for someone who feels the same way. As an Assessment Solution Strategist, you'll own the full lifecycle of assessment design and quality for a platform used by thousands of learners and organizations worldwide. This isn't a role where you'll be handed a template and told to fill it in. You'll shape the blueprints, apply the psychometric rigor, analyze the data, and drive the kind of continuous improvement that keeps our assessments genuinely best-in-class. If you're energized by the craft of measurement - and you want your work to directly impact how people demonstrate and grow their technical skills - this is the role for you. WHO YOU'RE COMMITTED TO BEING You believe assessment is a craft - and you bring that conviction to everything you build. A rigorous thinker. You approach every assessment with psychometric precision. Validity and reliability aren't checkboxes - they're non-negotiables. You know the difference between a good question and a great one. A curious innovator. You actively seek out AI tools and emerging methods to sharpen your work, and you share what you learn. You don't wait for direction to improve; you lead the charge. A collaborative partner. You work independently and cross-functionally - managing vendors, SMEs, and internal stakeholders - while keeping quality at the center of every working relationship. A data-driven decision maker. You trust the numbers. From item analysis to equating and calibration, you use data to continuously improve the portfolio - and you can explain what you found and why it matters.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at pluralsight? Share your experience