Chinese‑Speaking AI Quality Analyst (Freelance)

About the role

Gramian Consultancy is seeking Chinese‑speaking AI Quality Analysts to help a client improve conversational AI systems. This freelance position lasts two months and is fully remote, allowing candidates from several regions to contribute to high‑impact AI evaluation work.

Key responsibilities

• Create realistic multi‑turn conversational scenarios in Chinese.
• Evaluate AI‑generated responses for relevance, accuracy, usefulness and proper integration of personal context.
• Compare and rank multiple AI responses side‑by‑side, identifying grounding issues, unsupported assumptions, and incorrect personalization.
• Review conversation quality, tone, and naturalness, and write clear rationales and structured feedback.
• Verify that AI systems correctly utilize available context and data sources.
• Follow evaluation guidelines, maintain high‑quality standards, and manage evaluation data according to project requirements.

Required profile

• Professional proficiency in written and spoken Chinese.
• Bachelor’s degree or equivalent experience in a relevant field.
• Strong analytical and critical‑thinking abilities.
• Experience in AI evaluation, data annotation, content moderation, research, or similar analytical work (preferred).
• Ability to assess nuanced and subjective quality differences in AI responses.
• Willingness to use a primary personal Google account for evaluation purposes.
• Commitment of 30‑40 hours per week with a minimum overlap of 4 hours PST.

Required skills

• AI evaluation
• Data annotation
• Content moderation
• Research

What we offer

• Freelance contract for two months.
• 100 % remote work with flexible scheduling.
• Opportunity to influence the quality of next‑generation AI conversational systems.