Analytical Evaluator - AI Feedback

mercor

📍 Remote🌐 Remote🕐 28d ago🔗 himalayas

Job Description

### About the job **Mercor** connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include **Benchmark**, **General Catalyst**, **Peter Thiel**, **Adam D'Angelo**, **Larry Summers**, and **Jack Dorsey**. **Position:** Generalist Expert **Type:****Contract** **Compensation:****$70/hour** **Location:****Remote** ### Role Responsibilities * Evaluate **AI-generated responses** to ensure accuracy and depth in reasoning. * Provide structured written feedback to improve **AI model outputs**. * Identify nuances, implicit meanings, and gaps in reasoning in **AI-generated content**. * Write clear, precise, and well-evidenced rationales beyond surface-level observations. * Work **independently and asynchronously** to meet deadlines and improve **AI model performance**. ### Qualifications **Must-Have** * ****Bachelor's degree** from a top-500 globally ranked university preferred.** * **Strong analytical and written communication skills.** * **Ability to work independently and follow detailed task guidelines.** * **Strong critical reading skills.** * **Native **English fluency** required.** ### **Preferred** * **None specified.** ### **Application Process (Takes 20–30 mins to complete)** * **Upload resume** * **AI interview based on your resume** * **Submit form** ### **Resources & Support** * **For details about the interview process and platform information, please check:** * **For any help or support, reach out to:** **_PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity._** Originally posted on [Himalayas](https://himalayas.app)
Analytical Evaluator - AI Feedback at mercor | MergeJobs