All Jobs

Agent Evaluation AI Training Jobs

Remote AI training, data annotation, and model evaluation jobs tagged Agent Evaluation.

100 positions available

Software Engineer - AI Coding Agent Evaluation

Mindrift

CodingSafety & Red TeamingRemote
US

Shopify Shop App Agent Annotator

Mercor

Safety & Red TeamingGeneral AI TrainingRemote
$40 - $50 / hr Worldwide

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
KR, NZ, SG

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
AR, CO, CL

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
MA, DZ, TN

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
MY, ID, ZA

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
IN

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
JO, LB, TR

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
QA, KW, AE

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
EE, MT, BA

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
PL, CZ, HU

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
GR, IT

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
DK, FI, NO

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
CR, EC, JM

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
ES

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
FR

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
DE

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
AU

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
CA

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
GB

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
US

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
US

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
US

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
US

Software Engineering Evaluation Specialist

Mindrift

CodingSafety & Red TeamingRemote
US

Freelance Software Engineer - AI Coding Agent Evaluation

Mindrift

CodingSafety & Red TeamingRemote
US

Spanish Audio Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Italian Audio Evaluations Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Hindi Audio Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

German Audio Evaluations Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Geospatial Reasoning Specialist (Senior) - Freelance AI Trainer Project

Meridial

EngineeringGeneral AI TrainingRemote
ZA

Geospatial Reasoning Specialist (Senior) - Freelance AI Trainer Project

Meridial

EngineeringScienceRemote
ES

French Audio Evaluations Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Electrical Engineering Specialist - Freelance AI Trainer Project

Meridial

EngineeringSafety & Red TeamingRemote
US

Dutch Audio Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Audio Specialist- Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

Agentic Audio Specialist - Freelance AI Trainer Project

Meridial

AudioSafety & Red TeamingRemote
Worldwide

AI Tutor, Physics Specialist (contract), Handshake AI

Handshake

ScienceSafety & Red TeamingRemote
$80 (USA)

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
IT

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
PT

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
IN

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
MX, CL, CO

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
ES

Software Engineer — Agentic Search Systems

Mercor

CodingRemote
$80 - $150 / per-task Worldwide

AI Agent Power User

Micro1

General AI TrainingRemote
$80 - $150 / hr Worldwide

Enterprise AI Workflow Expert

Micro1

General AI TrainingBusiness & FinanceRemote
$80 - $150 / hr Worldwide

Agentic AI Expert

Micro1

CodingSafety & Red TeamingRemote
$70 - $126 / hr Worldwide

English Speaking Generalist

Micro1

General AI TrainingSafety & Red TeamingRemote
$20 - $30 / hr Worldwide

AI Evaluation Analyst

Micro1

General AI TrainingRemote
$20 - $30 / hr Worldwide

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
PT

Enterprise AI Agent Users

Mercor

General AI TrainingRemote
$30 / hr Worldwide

Member of Technical Staff, Enterprise AI

Micro1

CodingGeneral AI TrainingRemote
$100 - $130 / hr Worldwide

Cloud Computing Expert

Mercor

CodingEngineeringRemote
$1,750 - $2,150 / one-time USA

Personalized Life Assistant Expert

Mercor

General AI TrainingRemote
$50 - $200 / hr USA

Systems Engineer (Coding Agent Experience)

Mercor

CodingSafety & Red TeamingRemote
$85 / hr Worldwide

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
PL

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
KR

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
EE, LV, LT

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
MX, CL, CO

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
AR

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
PH

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
SG, MY, NZ

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
SA, QA, KW

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
ZA

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
RO, GR, HU

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
PT

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
IT

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
FR

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
ES

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
AU

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
CA

Freelance Agent Evaluation Engineer

Mindrift

CodingSafety & Red TeamingRemote
GB

Cloud Storage Management Expert

Mercor

CodingSafety & Red TeamingRemote
$45 - $60 / hr USA

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
GB

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
CA

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
DE

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
ES

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
FR

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
IT

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
PT

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
IE, BE, DK

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
RO, GR, HU

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
ZA

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
SA, QA, KW

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
IN

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
SG, MY, NZ

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
PH

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
BR

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
AR

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
MX, CL, CO

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
IN

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
EE, LV, LT

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
JP

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
KR

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
PL

Software / AI / IT / data (Meridian)

Mercor

CodingGeneral AI TrainingRemote
$100 - $200 / hr Worldwide

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
PL

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
KR

Freelance Agent Evaluation Engineer

Mindrift

General AI TrainingRemote
JP