Simulated Research Reviewer (MechE & Mat-Sci)
MercorDescription
Mercor is hiring Mechanical Engineering and Materials Science experts to review simulated-research environments for a leading AI lab.
What You'll Do
You will evaluate simulated-research environments, each built around a seed (underlying simulator/dataset). For each environment you will review input data and 3+ agent trajectories — each trajectory is a different prompt posed against the same seed, together with the model's full response.
Your structured feedback covers:
-
Trajectory Summarization — summarize what each agent did, how it reached its answer, and the scientific reasoning it used
-
Problem Quality — rate whether the problem is a realistic scientific question requiring real scientific skills
-
Construction Quality — assess context sufficiency, experiment utility, solvability, experiment selection importance, saturation/headroom, and scoring metric reasonableness
-
Question Diversity — evaluate how diverse the prompts are within the environment
-
Alternative Framing — suggest more natural or interesting task formulations for the same underlying simulator
Ideal Qualifications
-
Degree: Master's or PhD in Mechanical Engineering, Materials Science, or a closely related field
-
Research Experience: Hands-on experience with computational simulation, experimental design, or scientific computing
-
Analytical Writing: Ability to provide clear, structured technical feedback
-
Domain Depth: Strong command of core principles in your specialty area
Project Details
-
Start Date: Immediate
-
Duration: ~3 weeks (final delivery 6/26)
-
Commitment: Part-time, flexible hours
-
Pay: Hourly
Apply today to shape the next generation of AI research agents!
Interested in this position?
Apply directly on the company's website