The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.
At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.
Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems.
Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.
Content Review & Evaluation Specialist
About the Role
HumanSignal is seeking highly qualified education professionals with exceptional English language and writing skills to contribute to AI development projects. This role involves evaluating, annotating, and validating educational content across various subjects to improve AI model performance in teaching, tutoring, and educational content generation.
Compensation
Up to $40 USD/hourbased on qualifications and project complexity
Required Qualifications
Education
- Master's degree requiredin education or related field
- PhD strongly preferredin:
- Education
- Curriculum & Instruction
- Educational Psychology
- English/English Literature
- Linguistics
- TESOL/Applied Linguistics
- Or closely related educational disciplines
Degree Field Requirements
Candidates must hold degrees directly in education, English, or teaching-related fields. Acceptable programs include:
- Education (General, Elementary, Secondary)
- Curriculum & Instruction
- Educational Leadership
- English/English Literature
- Linguistics/Applied Linguistics
- TESOL/ESL Education
- Reading/Literacy Education
- Educational Psychology
Language Requirements
- Native or near-native English proficiency required
- Exceptional written and verbal communication skills
- Strong command of English grammar, syntax, and style
- Ability to identify and correct errors in writing across various contexts
Responsibilities
- Review and evaluate educational content for accuracy, clarity, and pedagogical effectiveness
- Assess AI-generated explanations, lesson plans, and instructional materials
- Annotate teaching strategies and learning approaches
- Validate content across multiple subject areas and grade levels
- Identify errors in grammar, spelling, punctuation, and style
- Provide detailed feedback on instructional quality and student engagement
- Evaluate content for age-appropriateness and educational alignment
- Review explanations for clarity and accessibility to diverse learners
Qualifications
- Deep understanding of pedagogical principles and instructional design
- Excellent writing and editing skills
- Strong analytical and critical thinking abilities
- Expertise in English grammar, composition, and rhetoric
- Experience developing or evaluating educational materials
- Familiarity with educational standards (Common Core, state standards, etc.)
- Understanding of differentiated instruction and diverse learning needs
- Ability to work independently and meet deadlines
Work Details
- Flexible, project-based work- work on your own schedule
- Remote position - work from anywhere
- Variable hours based on project availability and your capacity
- Ongoing training and calibration provided
- Quality-focused environment with performance feedback
Ideal Candidate Profile
- Current or former educators, curriculum developers, or educational researchers
- Strong background in classroom instruction or educational content creation
- Experience across multiple grade levels or subject areas
- Published work or demonstrated excellence in educational writing
- Passion for improving AI capabilities in educational contexts
How to Apply
Interested candidates should be prepared to:
- Submit CV/resume highlighting educational qualifications
- Provide proof of advanced degree(s)
- Complete a writing and content evaluation assessment
- Participate in a qualification review
HumanSignalis a leading provider of AI data annotation and labeling services, powering the development of next-generation AI systems. We work with top technology companies and research institutions to create high-quality training data.
HumanSignal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
