Review and score AI data tasks against clear guidelines to help train and evaluate AI models. Remote, flexible, project-based work. How it works: apply, a short screening, a trial evaluation task, then agreements and onboarding. We place shortlisted experts with our clients (AI labs, AI data partners and staffing partners). When you apply, you agree that we may share your profile with them for this and similar roles.
Role
Remote · Contract
Closes 05 Nov 2026
What you will do
Evaluate AI task submissions (prompts, responses, code, written answers) against a rubric and score them consistently.
Check outputs for accuracy, completeness, instruction-following and quality, and flag errors or unclear tasks.
Write short, clear feedback that explains each score so authors can fix issues.
Compare alternative answers and rank them with a reasoned justification.
Follow project guidelines, meet quality and turnaround targets, and raise ambiguities early.
Work remotely through the client's or partner's online platform.
What we look for
Bachelor's degree or equivalent experience; a STEM, finance, medical or language background is a plus.
Strong attention to detail and clear written English.
Comfortable following detailed written guidelines and applying a rubric consistently.
Good reasoning and fact-checking skills; coding, SQL or domain expertise helps for specialist projects.
Prior experience in evaluation, QA, review, annotation or RLHF is a plus, but not required.
A laptop or desktop and a stable internet connection; based in India and available for remote, project-based work.
Use only material you're allowed to share; never include confidential employer or client data.