Position Summary:

League is building the infrastructure behind our Benefits Navigation Agent — the AI that helps members understand and use their health benefits — and we're growing our panel of expert reviewers. The through-line is domain judgment: the situational, real-world reasoning that determines the guidance of our agent gives members is accurate, complete, and trustworthy.

You'll help validate the rubrics we use to assess the agent's answers, grade responses against accuracy and coverage standards, and pressure-test the scenarios that keep benefits guidance correct and trustworthy. This is a great fit for benefits and insurance professionals who want flexible, remote work — and who want their expertise to shape a product while it's still being built.

The kind of work you might do:

Engagements vary, but could include:

• Scenario design and pressure-testing — building and stress-testing the member scenarios the agent is evaluated against, so the rubric reflects the questions members actually ask and the failure modes that matter most.
• AI agent evaluation — supporting the development and validation of rubrics, grading AI-generated benefits guidance against structured accuracy and coverage standards, flagging where the agent misstates coverage or oversteps into advice it shouldn't give, and providing written feedback on how responses can be improved.
• Subject-matter input — bringing a benefits, claims, or regulatory perspective to how we define correctness, coverage, and the hard-fail boundaries the agent must never cross.

Specializations we're looking for:

We're building a multidisciplinary panel. You don't need to cover all of these — we're looking for depth in one or more of the following areas:

• Benefits plan design and administration — You validate that the agent correctly interprets a member's plan documents rather than plausibly paraphrasing them wrong. This is the foundation of every coverage answer the agent gives.
• Payer / claims operations and live-data interpretation — You ensure the agent doesn't just echo API numbers but understands what they actually mean, catching failure modes like pending claims, embedded deductibles, and accumulator confusion that only hands-on operations experience surfaces.
• Regulatory and compliance — You confirm the agent doesn't misstate legal entitlements or drift into legal or tax advice, helping define the hard-fail boundaries where an error carries real regulatory or member harm.
• Member navigation and advocacy — You keep scenarios grounded in the questions members actually ask and the emotional context around them, so the rubric rewards genuinely helpful navigation over answers that are technically correct but useless.
• Supplemental health solutions / point-solution knowledge — You validate that the agent matches supplemental solutions to real member need rather than over-steering or upselling, protecting member trust in the agent's recommendations.

Required:

• Meaningful hands-on experience in one or more of the specializations above (e.g., benefits administration, plan design, payer or claims operations, benefits regulatory/compliance, member advocacy, or supplemental/point-solution expertise)
• Based in Canada or the United States, with working knowledge of the relevant benefits and insurance landscape
• Strong command of where accurate benefits guidance ends and regulated advice (legal, tax, clinical) begins
• Reliable, detail-oriented, and dependable on deadline-driven async work
• Ability to access and operate within Google Workspace

Nice to have:

• Prior experience with evaluation or validation of AI products, or structured content/quality review
• Familiarity with self-funded vs. fully-insured plan mechanics, accumulators, coordination of benefits, or claims adjudication
• Genuine curiosity and interest about the role of AI in benefits navigation

Engagement Details:

• Fully remote and async-friendly
• Project-based, with everything from short one-off engagements to recurring cycles — steady, ongoing work available for experts who are a strong fit
• Flexible hours that work around your day job or other commitments
• Structured onboarding and calibration so expectations are clear from the start

Please note: this is a Contractor opportunity as we are building out our roster for talent for these engagement-centric projects.