Analytical Evaluator - AI Feedback
mercor
📍 Remote🌐 Remote🕐 28d ago🔗 himalayas
Job Description
### About the job
**Mercor** connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include **Benchmark**, **General Catalyst**, **Peter Thiel**, **Adam D'Angelo**, **Larry Summers**, and **Jack Dorsey**.
**Position:** Generalist Expert
**Type:****Contract**
**Compensation:****$70/hour**
**Location:****Remote**
### Role Responsibilities
* Evaluate **AI-generated responses** to ensure accuracy and depth in reasoning.
* Provide structured written feedback to improve **AI model outputs**.
* Identify nuances, implicit meanings, and gaps in reasoning in **AI-generated content**.
* Write clear, precise, and well-evidenced rationales beyond surface-level observations.
* Work **independently and asynchronously** to meet deadlines and improve **AI model performance**.
### Qualifications
**Must-Have**
* ****Bachelor's degree** from a top-500 globally ranked university preferred.**
* **Strong analytical and written communication skills.**
* **Ability to work independently and follow detailed task guidelines.**
* **Strong critical reading skills.**
* **Native **English fluency** required.**
### **Preferred**
* **None specified.**
### **Application Process (Takes 20–30 mins to complete)**
* **Upload resume**
* **AI interview based on your resume**
* **Submit form**
### **Resources & Support**
* **For details about the interview process and platform information, please check:**
* **For any help or support, reach out to:**
**_PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity._**
Originally posted on [Himalayas](https://himalayas.app)