AI Evaluation Engineer

About the role

Zof AI is looking for an AI Evaluation Engineer to design and run the tests that prove AI systems work as intended. The role sits at the core of the product, turning intuitive impressions into measurable evidence.

Key responsibilities

• Design and build evaluation suites for AI and agent products.
• Create verification harnesses that confirm AI outputs meet specifications.
• Define quality gates that determine what can be shipped.
• Translate domain expertise and customer requirements into testable checks.
• Identify and investigate failure modes such as regressions, hallucinations, and silent errors.
• Make evaluation results clear for engineers, product teams, and customers.
• Integrate evaluations into CI pipelines and the development workflow.
• Raise the company‑wide standard for what constitutes a “working” AI system.

Required profile

• Experience testing, evaluating, or QA‑ing complex software systems.
• Understanding of how large language models and agent systems can fail.
• Strong analytical rigor, skepticism, and attention to detail.
• Ability to write code for test harnesses and automation.
• Clear written and verbal communication skills.
• Comfort working in a fast‑moving environment with high ownership.

Required skills

• Test automation and QA methodology.
• Experience with LLM evaluation, benchmarks, or test infrastructure (nice to have).
• Familiarity with statistical evaluation methods (nice to have).

What we offer

• Monthly compensation of GHS 6,500‑13,000.
• Meaningful equity participation.
• Comprehensive living package including housing, meals, equipment, and wellness support where applicable.
• Access to premium AI development tools (e.g., MacBook Pro, advanced AI models, specialized IDEs).
• On‑site amenities such as basketball court, table tennis, foosball, massage, and fitness facilities.