All open roles

AI evaluation

Mathematics Expert - AI Training

  • Remote
  • Hourly contract

In this remote, hourly contractor role, you will design complex, challenging mathematics problems intended to test and stretch the limits of advanced AI models, and evaluate how well those models…

In this remote, hourly contractor role, you will design complex, challenging mathematics problems intended to test and stretch the limits of advanced AI models, and evaluate how well those models reason through them. Tasks are intentionally difficult and time-intensive, typically requiring three or more hours each to construct, solve, and document fully. Tasks may include:

Designing original, high-difficulty mathematics problems that probe the boundaries of current AI reasoning, including problems that SOTA models are likely to solve incorrectly

Developing complete, rigorous solutions and step-by-step reasoning that serve as reference answers

Evaluating AI-generated solutions for mathematical correctness and reasoning quality, identifying errors in method, conceptual gaps, and weak justification, and explaining corrections clearly in writing

Rating and comparing AI responses based on correctness, rigor, and adherence to the prompt

Profile Requirements

Master's degree or higher in Mathematics; PhD strongly preferred

Deep mathematical expertise with strong command of formal reasoning and proof construction, and the ability to construct novel, non-trivial problems

Ability to articulate complex mathematical concepts and corrections clearly and accurately in writing

Full professional English proficiency

Exceptional attention to detail

Reliable and self-directed, with consistent output quality on complex, time-intensive tasks in a remote, asynchronous workflow

Preferred Experience

Prior experience with AI data training, annotation, or model evaluation

Background in mathematics research, competition mathematics, or academic instruction

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

What happens next

  1. We review your application. A person on the team reads every one.
  2. We get in touch. If your background fits, we email you about the next step.
  3. You start on real work. Each listing says whether it is remote or on site.