Pay ยท estimate~$180k โ $245kMarket rate ยท not set by employer
PostedNov 21, 2026
LevelMid level
In short
We are seeking motivated Evaluation Specialists and recent graduates to contribute to a high-impact project focused on advancing artificial intelligence.
We are seeking motivated Evaluation Specialists and recent graduates to contribute to a high-impact project focused on advancing artificial intelligence. In this role, you will use your research, analytical reasoning, and writing skills to develop challenging questions and evaluate AI model performance.
You will create original question-and-answer pairs, conduct in-depth research, verify information across multiple sources, and provide clear explanations supported by reliable citations. No prior AI experience is required. Strong research abilities, critical thinking, and subject-matter knowledge are the key requirements.
Scope of Work
๐นDevelop original, challenging question-and-answer pairs designed to test the capabilities of advanced AI models across diverse subject areas.
๐นConduct in-depth research and cross-verify information using multiple reliable sources to ensure accuracy, completeness, and strong supporting evidence.
๐นCreate multi-step questions that require analytical reasoning, synthesis, and critical thinking rather than simple information retrieval.
๐นTest questions against AI models, analyze their responses, and refine the questions to adjust or increase their difficulty.
๐นDocument research processes and provide clear citations, evidence, and logical explanations to support each answer.
๐นRevise and improve content based on reviewer feedback while ensuring compliance with project guidelines and quality standards.
๐นMaintain consistency, accuracy, and clarity across all submitted tasks.
Preferred Qualifications
๐นStrong ability to conduct independent research and critically evaluate information from multiple sources.
๐นExcellent English writing skills, with a high level of precision and clarity. English fluency is required but does not need to be your first language.
๐นAbility to create nuanced, well-structured questions that assess deep understanding and complex reasoning.
๐นStrong analytical thinking, problem-solving, and information-synthesis skills.
๐นSelf-motivation, reliability, and accountability when working independently in a remote environment.
๐นInterest in emerging AI technologies and evaluating the capabilities and limitations of advanced AI models.
๐นPrevious experience in AI training, model evaluation, research, or content creation is an advantage but is not required.