AI Training Scenario Designer
MercorDescription
About the Role We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more. What You'll Do
-
Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more)
-
Write tasks that challenge an AI agent's ability to reason, filter, and prioritize
-
Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints
-
Document your work clearly in Airtable and Crucible
You're a Good Fit If You
-
Have strong written communication and attention to detail
-
Think creatively and enjoy constructing layered, realistic scenarios
-
Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms
-
Can spot inconsistencies and think critically about information quality
-
Work independently and manage your own workflow
-
Must Have - Undergrad degree, 2+ years professional experience.
-
Nice to have:
-
Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers
-
Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios
-
World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator
-
Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid
-
Interested in this position?
Apply directly on the company's website