AI Policy Reviewer (Remote)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance gatekeeper, protecting model integrity by spotting safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, evaluating safety, truthfulness, fairness and alignment with community guidelines.
• Identify over‑sensitive or under‑sensitive model behavior, handle ambiguous edge cases, and make nuanced judgement calls on satire, context, or emerging risks.
• Analyze data to uncover systematic flaws, report patterns of bias, hallucination, or policy gaps to Product and Engineering teams.
• Collaborate with Policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to provoke unsafe responses and help engineers adjust model behavior.
• Create high‑quality prompt‑response examples that serve as golden training sets.

Required profile

• Minimum 3 years experience in Trust & Safety Operations, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs, detect logical flaws, hallucinations, and subtle biases.
• Excellent written communication to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.
• Familiarity with LLMs (e.g., ChatGPT, Gemini) and comfort using dashboards, spreadsheets, and specialized review tools.

Required skills

• Experience with large language model platforms (ChatGPT, Gemini, etc.)
• Proficiency in spreadsheet software for data analysis
• Ability to use dashboard and content‑review tools

What we offer

• Fully remote work with flexible hours
• Opportunity to shape responsible AI practices at scale
• Collaboration with cross‑functional product, policy, and engineering teams