Probe

RL experiment tracking for rollouts and rewards

A reward curve tells you something changed. It doesn't tell you which rollouts changed or why. Probe records the rewards per step and what happened inside each rollout, so you and your coding agent can trace a jump or a collapse back to the samples behind it.

Tell your coding agent:

Install Probe on this machine and its coding agents. Read https://research.prbe.ai/install.md and follow it.

What you can follow

probe span add $RUN --type rollout --name rollout-0 --step 1
probe trial add $RUN jobs/my-job/trials/swe-fix__x1 --step 600

See Spans, trajectories and trials and Framework integrations.

Trainers it wires into

Ask your coding agent to run /instrument-code on your training script. The instrument-code skill wires Probe into Miles, TRL, verl, SkyRL and ART trainers and Harbor jobs, so every rollout is recorded as a sample, including trainers that already have their own tracker.

Why it helps

Learn more