Research Engineer, AI & Machine Learning (PhD Student)

Cobalt · Remote, US
Work typeRemote · Contract
Pay · estimate~$150k – $200kMarket rate · not set by employer
PostedNov 20, 2026
LevelMid level
In short Cobalt is hiring current Masters and PhD students to review reinforcement learning tasks and environments used to test whether frontier AI models can carry out real research and…
PYTHONDOCKERPYTORCHMACHINE LEARNING

📋 About the job

Job typeFlexible Contract (Remote)

Cobalt is hiring current Masters and PhD students to review reinforcement learning tasks and environments used to test whether frontier AI models can carry out real research and engineering work. Your job is to make sure each one is correct, fair, and actually measures what it claims to measure before it is accepted. If you enjoy finding the flaw in an experiment, the bug in a grader, or the loophole in a reward function, this role is built around that skill.

What you will do

  • Review reinforcement learning tasks end to end, including the task description, environment code, data, dependencies, reference solution, and automated tests or graders, and confirm that each part is correct and consistent with the others.
  • Run reference solutions and graders yourself to confirm that correct solutions pass, incorrect solutions fail, and results are reproducible. Because reinforcement learning results vary between runs and random seeds, you will check that tests are deterministic or use tolerances that are clearly justified.
  • Look for ways an agent could pass a task without doing the intended work, such as exploiting a reward signal, reading the answer from the environment, or satisfying a weak test, and document each issue so the task author can fix it.
  • Review how a frontier AI model attempted each task and judge whether its failure reflects a real gap in capability, or instead reflects ambiguous wording, a hidden assumption, a broken environment, or an unfair grader.
  • Write clear, specific feedback to task authors and work with them through revisions until the task meets the acceptance standard.
  • Track recurring problems across tasks and help improve the review checklist and quality standards over time.

Example tasks you might review include implementing proximal policy optimization or soft actor-critic from a paper’s description alone, finding the bug in a flawed reward function or environment, reproducing a reported learning curve and explaining a discrepancy, and running a sound statistical comparison between two agents across multiple random seeds.

Who we are looking for

  • Currently enrolled in a Masters or PhD program in machine learning, computer science, statistics, robotics, or a closely related field.
  • Hands-on experience with reinforcement learning through research, a thesis, coursework projects, or industry work. You should be comfortable reading an implementation and saying whether it is correct.…
📄 Read the full description → The rest of this listing is on the hiring partner’s site.
Interested in this role?Apply in one click — no JobQ account needed.
Apply now →
Research Engineer, AI & Machine Learning (PhD St...Cobalt
Apply now