Benchmark report

Task verified

6m 29s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Minor doc-fetch detour (HTML before .md) plus resolving the team id after /v2/user's defaultTeamId did not match any listed team; total time to first success 153s.

Where the time went

6:30 agent time
  • Research0:21
  • Attempt4:05
  • Verify2:03
6m 29sTotal elapsed
2:33Time to first success
0:00Waited on the owner

Judge reason

Saved evidence supports every criterion. code/api/marker.js logs `TPC_MARKER_LOG marker=${req.headers['x-tpc-marker']}`; evidence/03-deploy.txt shows a real CLI deploy (dpl_A6MVPh6Yu1SHysCVJL5fdbxVSVTM, READY, production) aliased to https://tpcbench-20261109154558-c7b268bc.vercel.app on Vercel's own domain. evidence/04-request.txt shows one curl with x-tpc-marker: tpc-marker-20261109154558-c7b268bc returning HTTP/2 200, server: Vercel, x-vercel-id pdx1::iad1::dbc9c-1794239229224-5ba0a5808a86. evidence/05-logs-poll.txt is the raw output of `vercel logs runtime --project ... --query '<marker>' --since 30m --json` with a matching record (timestamp 15:47:09.420Z, same requestId and deploymentId, message 'TPC_MARKER_LOG marker=tpc-marker-20261109154558-c7b268bc'), printed in the report and in evidence/06-matched-line.txt — Vercel's own logs, not a mock. Cleanup: evidence/08-cleanup.txt '✓ Deleted tpcbench-...'; evidence/09-verify-gone.txt shows HTTP/2 404 with x-vercel-error: DEPLOYMENT_NOT_FOUND and 0 projects matching the run suffix. Only resource created is tpcbench-20261109154558-c7b268bc; token was read from a private file into VERCEL_TOKEN by bin/v and my own grep over saved files found no token value. Docs snapshot confirms runtime log retention is on by default, so no enable step existed.

Attempt record

  1. 1:18Answered from saved key: Vercel API token (VERCEL_TOKEN)no wait
  2. —First success verified

Attempt artifacts saved.