Domain Advisor Consultant

invisible

📍 Remote🌐 Remote🕐 9d ago🔗 himalayas

Job Description

**Engagement Type:** Business-to-Business (B2B) / Independent Contractor **Location:** Remote **The Opportunity: Define the "Ground Truth" for Generative AI** We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs). This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the **"Gold Standard"** rubrics that teach models how to think like an expert. ### **Scope of Services & Deliverables** This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables: * **Rubric Architecture:** Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field. * **"Golden" Data Curation:** Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training. * **Expert Gap Analysis:** Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of _why_ the model failed and how a human expert would have approached the problem. * **Advisory on Complexity:** Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios. ### **Consultant Profile: Who We Are Looking To Partner With** We are seeking independent business owners, freelancers, and academic leaders who possess: * **Elite Domain Mastery:** Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative). * **Professional Autonomy:** You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology. * **Interest in Shaping Technology:** While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession. * **Articulate Reasoning:** The ability to not just know the right answer, but to articulate the _reasoning process_ clearly in writing. ### **Engagement Structure & Compliance** This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations. * Engagements are **project-based and non-exclusive**, allowing you to continue working with other clients * You have flexibility in **how you complete deliverables**, in alignment with project requirements * Scope, timelines, and compensation are **defined in advance** for each assignment * **Remote & Independent:** You provide your own workspace and equipment. * **Global Compliance:** Candidates must be properly registered to operate as independent contractors in their country of residence. ### **Why Top-Tier Consultants Partner With Us** * **Intellectual Challenge:** This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine. * **High-Value Impact:** Your input directly influences the safety and capability of models used by millions. * **Flexible Revenue Stream:** Supplement your primary consulting business with flexible, high-value project work. Originally posted on [Himalayas](https://himalayas.app)
Domain Advisor Consultant at invisible | MergeJobs