Assessment Solution Strategist

Job Description:

Assessments are only as powerful as the thinking behind them. At Pluralsight, we believe that measuring skills well is one of the most meaningful things you can do for a technologist's career — and we're looking for someone who feels the same way.

As an Assessment Solution Strategist, you'll own the full lifecycle of assessment design and quality for a platform used by thousands of learners and organizations worldwide. This isn't a role where you'll be handed a template and told to fill it in. You'll shape the blueprints, apply the psychometric rigor, analyze the data, and drive the kind of continuous improvement that keeps our assessments genuinely best-in-class.

If you're energized by the craft of measurement — and you want your work to directly impact how people demonstrate and grow their technical skills — this is the role for you.

WHO YOU'RE COMMITTED TO BEING

• You believe assessment is a craft — and you bring that conviction to everything you build.

• A rigorous thinker. You approach every assessment with psychometric precision. Validity and reliability aren't checkboxes — they're non-negotiables. You know the difference between a good question and a great one.

• A curious innovator. You actively seek out AI tools and emerging methods to sharpen your work, and you share what you learn. You don't wait for direction to improve; you lead the charge.

• A collaborative partner. You work independently and cross-functionally — managing vendors, SMEs, and internal stakeholders — while keeping quality at the center of every working relationship.

• A data-driven decision maker. You trust the numbers. From item analysis to equating and calibration, you use data to continuously improve the portfolio — and you can explain what you found and why it matters.

WHAT YOU'LL OWN

• Blueprint to delivery | Design assessment blueprints, generate item prompts, develop items across the full complexity spectrum, and manage forms from creation through continuous improvement.

• Performance monitoring & analytics | Run item and test analyses, calibration, equating, scaling, and reliability/validity checks. Flag issues, investigate root causes, and drive continuous improvement across the assessment portfolio.

• Standards, content guidelines & QA | Contribute to assessment content standards and ensure the portfolio aligns to curriculum and learning objectives. Apply item-level QA with a sharp editorial eye and advise on evidence-based assessment practices.

• Vendor & partner relationships | Lead day-to-day collaboration with SMEs and vendors, support SOW execution, and manage multiple concurrent projects to deadline — independently and without hand-holding.

• Documentation & process ownership | Author and maintain processes, procedures, and decisions related to assessment design, development, and continuous quality monitoring. Resolve complex queries from internal partners and escalate where appropriate.

EXPERIENCE YOU'LL BRING

• Bachelor's degree in educational or psychological measurement, instructional design, psychometrics, or a related field

• 3+ years of relevant professional experience designing and developing high-integrity assessments

• Strong command of assessment types, taxonomy, and principles of validity and reliability

• Excellent writing, editing, and quality assurance skills

• Experience working with vendors, SMEs, and cross-functional teams

• Proficiency with learning management systems, authoring tools, and item banks

• Strong organizational and project management skills with the ability to manage multiple projects simultaneously

• Strong analytical skills and a data-driven approach to decision making

• Exceptional attention to detail

Preferred qualifications:

• Master's degree or 3–5 years of specialized experience in assessment design, development, or measurement

• Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security)

• Background in psychometrics or data analysis using tools like Excel, R, or SPSS

• Knowledge of accessibility and Universal Design for Learning (UDL) standards

• Experience with adaptive testing or automated assessment tools

• Familiarity with the Pluralsight platform and value proposition

• Experience with SaaS software (e.g., ZenDesk, Asana, Confluence, Smartsheet)

Requirements

• This is a remote role; however, applicants located within 45 miles of our Westlake/Dallas, TX office should expect to work on-site Tuesday through Thursday, with remote flexibility on Mondays and Fridays. This approach enables more effective collaboration, quicker decision-making, and a stronger culture, while still providing flexibility.

• We work in a blended environment that supports collaboration, flexibility, and connection across teams.

• We are mission-driven, shaping the future of tech upskillling and delivering impact that matters.

• We foster a culture of inclusion and belonging, where everyone can contribute and thrive.

• We are always learning, creating an environment where you can take on new challenges, expand your skills, and grow with purpose.

• Benefits include competitive compensation, bonus eligibility, comprehensive medical coverage, unlimited PTO, wellness reimbursement, professional development funds, and more.

Pluralsight provides the only learning platform dedicated to accelerating the technology skills and capabilities of today’s tech workforce. Thousands of companies, government organizations and individuals around the world rely on Pluralsight to support critical technology skill development in areas that are crucial to innovation including artificial intelligence, cloud computing, cybersecurity, software development, and machine learning. We offer highly curated content developed by vetted technology experts, industry leading skill assessments, and hands on, immersive learning experiences designed to help individuals skill-up faster.

This role is primarily performed in an office or home office setting and involves standard computer-based work.

Bring yourself. Pluralsight is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or veteran status. We also consider qualified applicants with criminal histories, consistent with EEOC guidelines and local laws.

If you need an accommodation to apply, interview, or perform essential job functions, please visit the bottom of our website to learn how to request an accommodation. Learn more about our commitment to diversity, equity, inclusion, and belonging in our DEIB Report.

The annual US base salary range for this role is $80,000-$100,000 USD. Actual compensation will depend on location, skills, experience, and other factors. Additional benefits and bonuses may apply.

Applications must be submitted within 90 days after the initial posting date to be considered.

Please be aware of recruiting scams. We’ll only contact you from an @pluralsight.com email or verified channels. We never ask for sensitive personal info or payments as part of the hiring process. All openings are posted on our Careers page.