Back to Jobs

AI Training Scenario Designer

Mercor
Pay
$30 - $80 / hr
Hourly
Location
Worldwide
Remote
Posted
May 28, 2026

Description

About the Role We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more. What You'll Do

  • Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more)

  • Write tasks that challenge an AI agent's ability to reason, filter, and prioritize

  • Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints

  • Document your work clearly in Airtable and Crucible

You're a Good Fit If You

  • Have strong written communication and attention to detail

  • Think creatively and enjoy constructing layered, realistic scenarios

  • Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms

  • Can spot inconsistencies and think critically about information quality

  • Work independently and manage your own workflow

  • Must Have - Undergrad degree, 2+ years professional experience.

  • Nice to have:

    • Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers

    • Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios

    • World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator

    • Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid

Interested in this position?

Apply directly on the company's website