Computer Science Domain Expert – Remote (Pay per Task)

About the role

We are looking for highly qualified Computer Science domain experts to design and evaluate advanced AI benchmark problems. This remote, short‑term contract role allows you to apply your PhD‑level knowledge to create challenging tasks that test AI reasoning across a range of CS topics.

Key responsibilities

• Design sophisticated computer‑science problems covering algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Write clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Assess AI‑generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks for undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality and benchmark reliability.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Deep expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Strong analytical, critical‑thinking, and written communication skills.
• Attention to detail in evaluating assumptions, definitions, edge cases, and solution validity.
• Ability to deliver high‑quality feedback on AI‑generated responses.

Required skills

• Python (desirable)
• Data Analysis (desirable)

What we offer

• Pay per approved task: $250 per task.
• Flexible remote work with up to 40 hours/week and a 4‑hour overlap with PST.
• Three‑month contract with immediate start.