Description

Role Overview\nThe Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice.\nOccupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.\n\nKey Responsibilities\n- Review submissions requiring professional or technical domain knowledge\n- Validate factual accuracy, terminology, and real-world applicability within the domain\n- Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance\n- Evaluate alignment with professional standards, norms, and best practices\n- Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts\n- Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise\n- Identify high-risk errors related to safety, ethics, or misuse\n- Escalate ambiguous or high-impact issues appropriately\n- Maintain clear documentation of review decisions and reasoning\n\nRequired Qualifications\n- Advanced degree, professional certification, or equivalent experience in the relevant occupation or field\n- 5+ years of professional experience practicing in that domain\n- Demonstrated experience with:\n-- Evaluation, review, auditing, or supervisory responsibilities OR\n-- Teaching, mentoring, training, or assessing professional work\n- Strong understanding of professional boundaries, risk, and compliance considerations\n- Excellent written communication skills suitable for formal feedback\n\nPreferred Qualifications\n- Prior experience reviewing AI-generated or training data content\n- Familiarity with compliance, regulatory, or ethical standards in the field\n- Experience translating expert knowledge into clear, structured explanations\n- Comfort working with evolving guidelines and iterative feedback cycles\n\nKey Competencies\n- Subject matter expertise\n- Risk awareness and safety judgment\n- Guideline fidelity\n- Clear, corrective feedback\n- Professional integrity\n\nExpectations \n- Strict adherence to confidentiality and data protection requirements\n- Consistent application of guidelines across all reviews\n- Willingness to update evaluation approach as standards evolve\n- Professional, unbiased, and respectful communication at all times\n\nCompensation & Logistics\n- $50 to $75 per hour, depending on expertise and relevance, with bonuses for key contributions\n- Begins with a paid trial period\n- Paid every two weeks based on approved and tracked hours\n- Fully remote and async friendly, work at your own pace within flexible deadlines\n- Employment type: Contract, flexible hours (part-time and full-time options).\n- Location: United States or Canada