Backend Engineer (Python/JavaScript) – Remote, $15/hr

About the role

We are looking for a Backend Engineer to create and maintain multi‑agent benchmark tasks that simulate real‑world code changes. This short‑term contract (4 weeks) is fully remote and offers flexible hours with a required overlap with Pacific Standard Time.

Key responsibilities

• Design and build benchmark tasks based on open‑source bug fixes, migrations, and refactors.
• Integrate tasks with the Harbor evaluation framework and run them inside Docker containers.
• Write precise task instructions, including file paths, function signatures, expected behavior, and constraints.
• Develop Python verification scripts to check the correctness of agent‑generated code.
• Create decomposition strategies to split complex changes across independent sub‑agents.
• Debug, run, and refine tasks in containerised environments to ensure reproducibility.
• Evaluate performance signals and continuously improve task quality, clarity, and difficulty.

Required profile

• Strong experience in Python and JavaScript development.
• Familiarity with AI coding benchmark suites such as SWE‑bench or Terminal‑Bench.
• Proven ability to navigate large open‑source codebases (e.g., Django, Flask, FastAPI, Node.js).
• Comfortable with Git workflows, including pull requests, diffs, and cherry‑picking.
• Hands‑on experience with Docker, Dockerfiles, and container debugging.
• Experience writing automated tests using pytest, unittest, or custom assertions.

Required skills

• Python
• JavaScript
• Docker
• Git
• pytest / unittest
• Django
• Flask
• FastAPI
• Node.js
• AI coding benchmark tools (SWE‑bench, Terminal‑Bench)