Mathematics Expert (Python & AI)

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are seeking a mathematics-focused professional to support an advanced AI research initiative developing high-quality STEM coding datasets. In this role, you will create rigorous mathematical problems , implement verified Python solutions, and develop evaluation tests designed to assess the capabilities of frontier AI models. The position combines mathematical problem-solving, scientific programming, and AI quality evaluation , with a strong emphasis on accuracy, determinism, and first-submission quality.

CONTRACT: Contractor assignment, 4 weeks

COMMITMENT: Hourly, up to 40h/week

LOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam

PROCESS: Interest Check Form, CV and Google Scholar review

Key Responsibilities

- Author mathematical coding tasks containing one main problem and at least 3 logically connected sub-problems that progressively build toward the main solution.
- Implement verified golden solutions in Python with complete unit test coverage.
- Design discriminative test cases that distinguish correct from incorrect AI-generated outputs.
- Perform quality control validation using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics.
- Refine problem specifications, solutions, and test cases based on QC feedback.
- Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron.
- Ensure mathematical correctness, well-posedness, determinism, and compliance with project quality standards.
- Maintain high first-submission quality and minimize rework, targeting consistent L1 approval.
- Participate in review sessions, feedback meetings, and project standups during required overlap hours.

Requirements

- Master's degree or PhD in Mathematics .
- Strong Python programming skills with experience in scientific computing.
- Experience using scientific Python libraries such as NumPy, SciPy, SymPy , or relevant domain-specific tools.
- Ability to formulate rigorous mathematical problems with clear constraints and expected outputs.
- Experience implementing scientific or mathematical solutions with unit tests and deterministic outputs.
- Prior experience in AI data annotation, scientific research, or scientific writing.
- Familiarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessment.
- Published research or academic project experience in mathematics or another STEM discipline.