Remote Ruby Software Engineer (Freelance)

About the role

We are seeking an experienced Ruby software engineer to join our AI‑focused team. You will work remotely on building and evaluating datasets that test large language models (LLMs) against realistic software engineering problems.

Key responsibilities

• Analyze and triage GitHub issues from trending open‑source libraries.
• Set up and configure code repositories, including Dockerization and environment provisioning.
• Evaluate unit‑test coverage and overall code quality.
• Modify and run codebases locally to assess LLM performance in bug‑fixing scenarios.
• Collaborate with researchers to select challenging repositories and issues.
• Lead and mentor junior engineers on project tasks.

Required profile

• Minimum 3 + years of professional software engineering experience.
• Tech‑lead level competence with complex codebases.
• Strong experience with Ruby and a solid understanding of Git workflows.
• Proficiency in Docker and basic software pipeline setup.
• Comfortable running, modifying, and testing real‑world projects locally.
• Experience with open‑source contributions or evaluation is a plus.

Required skills

• Ruby
• Git
• Docker

What we offer

• Fully remote freelance contract (20, 30 or 40 hours per week).
• Opportunity to work on cutting‑edge AI and LLM evaluation projects.
• Flexible schedule with a required 4‑hour overlap with PST.
• Collaboration with leading AI researchers and engineers.