AI Quality Analyst – Arabic (Remote, $11.5/hr)

About the role

We are looking for an Arabic‑speaking AI Quality Analyst to help improve personalized large‑language‑model responses. This short‑term, remote contract focuses on designing prompts, evaluating AI outputs, and ensuring data privacy while working closely with a team based in the Pacific time zone.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
• Perform side‑by‑side (SxS) ranking of AI outputs and identify grounding errors or forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Strong experience in data annotation, AI quality evaluation, content moderation, or related analytical roles.
• Excellent analytical thinking and attention to detail.
• Ability to assess nuanced and ambiguous AI responses.
• BS/BA degree or equivalent experience in a relevant analytical field.
• Self‑motivated, able to work independently in a remote setting.
• Reliable desktop/laptop with stable internet connection and full‑time availability (8 hours/day) with a 4‑hour overlap with PST.

Required skills

• Arabic fluency (reading and writing).
• Experience with data annotation and AI quality evaluation.
• Strong written communication and structured feedback abilities.

What we offer

• Short‑term (2‑month) contract.
• Remote work with flexible schedule.
• Compensation at $11.5 per hour.