Assessment Scientist

About the role
Location: We are only able to hire in the US or Canada for this role.

Workera is building the next generation of assessments—AI-native, adaptive, and grounded in science. As an AI Assessment Scientist, you’ll sit at the center of that work, designing and delivering assessments in a world where expert judgment, AI-assisted workflows, and agentic systems work in tandem. You’ll apply rigorous skill models and evidence-centered design to ensure what we ship elicits real, defensible evidence of skill—not superficial proxies. This is a hands-on, individual contributor role for someone who recognizes that traditional assessment methods and standards were designed for a different era and feels a responsibility to thoughtfully evolve them. The assessments you design will power hiring, mobility, and upskilling decisions for some of the world’s largest enterprises. If you’ve wanted to apply deep assessment science in a new medium where the work ships, scales, and is actually used, this role offers that opportunity.

About your team

You’ll be part of Workera’s AI Assessment Science team, working closely with senior scientific leadership while owning visible, end-to-end assessment outcomes in the product. You will collaborate with assessment developers, product managers, designers, and AI/ML partners from shaping through launch.

What You’ll Do:

Within 3 months, you will:

• Gain a deep understanding of Workera’s AI-native assessment approach, including skill modeling, evidence-centered design (ECD), and Workera’s assessment authoring product, Compose
  
  
• Use AI-assisted and agentic workflows in assessment creation, applying expert judgment to ensure clear, meaningful, and defensible evidence of real skills
  
  
• Collaborate closely with assessment developers, skill strategy managers, designers, and science leadership to shape and deliver assessments in real product contexts
  
  

Within 6 months, you will:

• Improve and refine AI-assisted and agentic assessment workflows and supporting operations, increasing efficiency, consistency, and assessment quality at scale
  
  
• Identify and eliminate manual bottlenecks while preserving rigorous, skill-centric assessment standards
  
  
• Guide contractor-based assessment development and maintenance, setting clear standards and examples and maintaining a high, consistent quality bar across domains
  
  

Within 9 months, you will:

• Make assessment creation and review processes more robust across multiple applications, domains, and customer use cases
  
  
• Maintain and evolve Workera’s signature assessment catalog, ensuring coherence, quality, and defensible skill evidence as the platform scales
  
  
• Optimize the distributed contractor model by improving collaboration, review processes, and synthesis of contributions
  
  
• Maintain, evolve, and future-proof assessment tooling, templates, and quality standards used by assessment developers and clients

*Please note as we are a dynamic and quickly growing scale-up, things are always subject to change*

What You’ll Bring

• Master’s or PhD in Industrial–Organizational Psychology, Psychometrics, Educational Measurement, or a closely related field
• Experience designing and delivering high-stakes assessments (e.g., hiring, certification, workforce mobility)
• Experience using AI-assisted workflows to generate, evaluate, or scale assessment content
• Strong applied expertise in evidence-centered design (ECD) and psychometrics; working knowledge of IRT and related models
• Ability to independently own complex and customized assessment work end to end, including collaboration with internal and client stakeholders
• Experience reviewing and elevating work produced by contractors or distributed contributors
• Clear, precise communication—especially when translating science into concrete decisions
• Proficiency in utilizing AI tools such as ChatGPT or equivalent digital assistants and applying them effectively within your work context.