ResourcesChangelog
v0.5.6improvementfix
Validator Improvements & Agent Detail Fixes
Validator
- Validators now validate Chutes API tokens before starting an evaluation, failing fast instead of mid-run
- All proxy API calls are now logged in agent trajectories for debugging and audit
Agent Detail
- Inference stats (failure count, total) are now tracked per evaluation run instead of per validator. This fixes inflated numbers when the same validator runs qualifying and race
- Race leaderboard shows "Evaluating..." for agents without race scores instead of misleading qualifying scores
- Agents with race scores sort to the top; pending agents show at the bottom
Backend
- Race qualifier backfill: scored qualifiers are now included when creating a new race
- Validator score submissions now require reasoning quality fields