AI Safety Specialist - Evaluation Expert

### About the job **Mercor** connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include **Benchmark**, **General Catalyst**, **Peter Thiel**, **Adam D'Angelo**, **Larry Summers**, and **Jack Dorsey**. **Position:** AI Safety Practitioner **Type:****Contract** **Compensation:****$60–$70/hour** **Location:****Remote** ### Role Responsibilities * Evaluate **AI-generated responses** for safety, factual accuracy, policy compliance, and overall quality. * Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains. * Apply and refine evaluation rubrics for **RLHF**, **SFT**, and **AI safety benchmarking**. * Identify unsafe outputs, hallucinations, reasoning failures, and policy violations. * Provide structured feedback to improve model alignment and safety performance. * Collaborate with **AI researchers** and safety teams on ongoing evaluation initiatives. ### Qualifications **Must-Have** * ****Bachelor's degree** or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.** * ****5+ years** of professional experience in **AI Safety**, Trust & Safety, journalism, public policy, scientific research, security, or a related field.** * **Excellent written **English**, critical thinking, and analytical reasoning skills.** * **Ability to consistently evaluate nuanced and policy-sensitive scenarios.** ### **Preferred** * **Experience with **AI Safety**, **RLHF**, **SFT**, Trust & Safety, or AI evaluation.** * **Familiarity with safety policies, content moderation, or evaluation rubric development.** * **Experience reviewing complex, high-risk, or ambiguous content.** ### **Application Process (Takes 20–30 mins to complete)** * **Upload resume** * **AI interview based on your resume** * **Submit form** ### **Resources & Support** * **For details about the interview process and platform information, please check:** * **For any help or support, reach out to:** **_PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity._** Originally posted on [Himalayas](https://himalayas.app)