Mathematics Expert (Python & AI)

About the role

Gramian Consultancy is seeking a mathematics‑focused professional to support an advanced AI research initiative that creates high‑quality STEM coding datasets. The role involves designing rigorous mathematical problems, implementing verified Python solutions, and building evaluation tests to assess frontier AI models. Accuracy, determinism, and first‑submission quality are essential.

Key responsibilities

• Author mathematical coding tasks that include a main problem and at least three logically connected sub‑problems.
• Implement golden solutions in Python with full unit‑test coverage.
• Design discriminative test cases that differentiate correct from incorrect AI‑generated outputs.
• Perform quality‑control validation using the Central Task Platform, applying Tier 1 structure checks and Tier 2 quality rubrics.
• Refine problem specifications, solutions, and test cases based on QC feedback and optimize for Pass@K evaluation criteria across multiple LLM judges.

Required profile

• Master's degree or PhD in Mathematics.
• Strong Python programming experience with scientific computing.
• Experience using scientific Python libraries such as NumPy, SciPy, SymPy, or related tools.
• Ability to formulate rigorous mathematical problems with clear constraints and expected outputs.
• Prior experience in AI data annotation, scientific research, or scientific writing.
• Familiarity with LLM evaluation frameworks and coding benchmarks.
• Published research or academic project experience in mathematics or another STEM discipline.

Required skills

• Python
• NumPy
• SciPy
• SymPy
• Scientific computing
• Unit testing
• AI data annotation
• LLM evaluation frameworks