Rubrics Evaluator (Professional experience)

Role Overview

Mercor is seeking experienced enterprise professionals to contribute to an AI evaluation and benchmarking project with a leading AI lab. Contributors will help assess the quality of AI-generated responses, reasoning, and decision-making across complex business and operational scenarios. This opportunity is ideal for professionals with strong analytical judgment and experience navigating enterprise environments such as consulting, finance, law, operations, manufacturing, engineering, or related domains.

Key Responsibilities

• Evaluate AI-generated outputs using structured rubrics and scoring frameworks

• Assess qualitative and quantitative reasoning across enterprise-focused scenarios

• Review business, operational, legal, financial, or strategic analyses for accuracy and clarity

• Identify gaps, inconsistencies, or weak reasoning in AI-generated content

• Provide written justification and feedback to support evaluation decision

Ideal Qualifications

• Professional degree in a relevant field such as business, law, finance, engineering, operations, or a related discipline

• 4+ years of experience in an enterprise environment

• Background in areas such as consulting, finance, legal operations, manufacturing, operations, engineering, or corporate strategy

• Strong quantitative and qualitative reasoning skills

• Availability through Tuesday, May 19th

• Excellent written communication and attention to detail

• Comfortable evaluating complex business and operational scenarios independently

Application Process

• Make sure your Mercor profile reflects your latest work experience

• Selected applicants may complete a short evaluation exercise

• Qualified contributors will be contacted with next steps and project details