AI Agent Evaluation Engineer

Mindrift

Mindrift seeks part-time AI Agent Evaluation Engineers to design tasks for coding agents. Leverage your Python and full-stack skills with competitive compensation.

Last checked on June 13, 2026. We may earn a commission when you click through.

If you have a strong background in Python and enjoy challenging AI tasks, this position offers a unique opportunity.

✓ Flexible part-time schedule ✓ Opportunity to shape AI testing ✓ Competitive hourly rate

This listing may have expired or is no longer available. Information shown may be outdated.

AI Agent Evaluation Engineer

Mindrift

Updated 2 months ago

Apply now →

You'll be redirected to za.talent.com

KuGompo City Full-Time

If you have a strong background in Python and enjoy challenging AI tasks, this position offers a unique opportunity.

About this role

Mindrift seeks part-time AI Agent Evaluation Engineers to design tasks for coding agents. Leverage your Python and full-stack skills with competitive compensation.

About the Company

Mindrift is an innovative company focused on advancing AI technology through project-based opportunities.

Key Highlights

✓ Part-time project-based role
✓ Focus on AI coding agent evaluation
✓ Competitive pay up to $24 per hour
✓ Opportunities for experienced developers
✓ Remote work not available

💡 Honest Take: This role is ideal for experienced developers but may not suit those seeking full-time employment or remote work.

Pros

✓ Flexible part-time schedule
✓ Opportunity to shape AI testing
✓ Competitive hourly rate
✓ Engaging work environment

Cons

✗ Not a full-time position
✗ No remote work options
✗ Requires significant experience
✗ Work is project-based with potential gaps

Best For: This role targets experienced software engineers eager to work on innovative AI projects.

Watch Out: Candidates should be prepared for project-based work, which may lead to inconsistent hours.

Apply for this position →

You'll be redirected to za.talent.com

What Customers Say

Feedback from previous employees highlights a dynamic work environment but notes the inconsistency in project availability.

Expert Review

Mindrift's AI Agent Evaluation Engineer role offers a stimulating opportunity for experienced developers with a flair for AI. The part-time, project-based structure allows flexibility, but candidates should be prepared for potential gaps between projects. Compensation can reach $24 per hour, competitive option in the field.

This position focuses on creating realistic coding tasks for AI agents, which requires a strong proficiency in Python and full-stack development. It's an excellent chance for those passionate about shaping AI testing methodologies.

However, this role is not a fit for everyone, especially those seeking stable, full-time employment or remote working conditions. The lack of remote options may deter some candidates. For those who thrive on challenges and have the required experience, this could be a rewarding role.

For more details, refer to Mindrift's official page here.