Benchmark report

Task verified

5m 15s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Almost nothing: two doc fetches to confirm the /v2/pipeline body shape before coding; first success recorded at 105.8s with zero failed commands.

Where the time went

5:15 agent time
  • Research0:16
  • Attempt3:35
  • Verify1:23
5m 15sTotal elapsed
1:46Time to first success
0:00Waited on the owner

Judge reason

Saved evidence independently supports every criterion. work/03-http-sql.mjs uses only Node stdlib fetch() POSTing to https://tpcbench-a9f319cfa2a9-rickchen.aws-ap-northeast-1.turso.io/v2/pipeline (Turso Hrana-over-HTTP) with no libsql/pg/net/ws client and no node_modules (evidence/13-secret-scan.txt). Real Platform API responses: create DB 200 (evidence/03-create-database.json, name tpcbench-a9f319cfa2a9 with run-unique suffix), scoped DB auth JWT redacted (04). Data plane: DROP/CREATE TABLE items 200 (05), two INSERTs with affected_row_count 1+1 and last_insert_rowid 1,2 (06), SELECT returning exactly the two Hrana rows [1,widget,7],[2,gadget,42] (07), and printed rows in 09-http-sql-stdout.txt/08-rows-printed.json match the saved response byte-for-byte. Cleanup graded: DELETE returned HTTP 200 {"database":"tpcbench-a9f319cfa2a9"}, follow-up GET returned HTTP 404 'record not found', the post-delete database list contains 0 occurrences of the name, and a post-delete /v2/pipeline POST returned 502 'no route configured for host' (evidence/11, 12). No password or password-bearing connection string appears anywhere (create response has password:""; API token read from the benchmark response file only). Transcript shows no fabricated or mocked responses and no failed commands.

Attempt record

  1. 0:33Answered from saved key: TURSO_API_TOKENno wait
  2. —First success verified

Attempt artifacts saved.