MCP & Tools Python Developer - Agent Evaluation Infrastructure

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves

While each project involves unique tasks, contributors may:

• Develop and maintain MCP-compatible evaluation servers
• Implement logic to check agent actions against scenario definitions
• Create or extend tools that writers and QAs use to test agents
• Work closely with infrastructure engineers to ensure compatibility
• Occasionally help with test writing or debug sessions when needed
• Apply professional judgment to assess AI responses

What we look for

This opportunity is a good fit for python engineers for a new project focused on developing Model Context Protocol (MCP) servers, open to part-time, non-permanent projects. Ideally, contributors will have: 

• Degree in Computer Science, Software Engineering or related fields
• 4+ years of Python development experience, ideally in backend or tools
• Solid experience building APIs, testing frameworks, or protocol-based interfaces
• Understanding of Docker, Linux CLI, and HTTP-based communication
• Familiarity with how LLM agents are prompted, executed, and evaluated
• Clear documentation and communication skills - you’ll work with QA and writers
• English proficiency - B2

How it works

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Effort estimate 

Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Payment

• Paid contributions, with rates up to $80/hour* 
• Fixed project rate or individual rates, depending on the project
• Some projects include incentive payments

*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.