Computer Science Specialist – Remote (Pay per Task)

About the role

We are seeking a Computer Science Specialist to design and evaluate advanced CS problems that test AI model performance. This remote, short‑term contract offers $250 per approved task and requires up to 40 hours per week with a 4‑hour overlap in PST.

Key responsibilities

• Design challenging computer‑science problems across algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Develop clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks for undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Deep expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Strong analytical, critical‑thinking, and written communication skills.
• Attention to detail in evaluating assumptions, definitions, edge cases, and solution validity.
• Ability to deliver high‑quality feedback on AI‑generated responses.
• LinkedIn profile must be included in the resume; background check required after onboarding.

Required skills

• Python (desirable)
• Data analysis (desirable)

What we offer

• Flexible remote work arrangement.
• Task‑based compensation of $250 per approved task.
• Opportunity to influence cutting‑edge AI evaluation benchmarks.