Benchmark report

Task verified

3m 49s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • AInstall
  • AAuth
  • SExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth A, Execute S, Docs S, Current AAInstallAAuthSExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Resend's Cloudflare edge returned an undocumented non-JSON 403 ('error code: 1010') to urllib's default User-Agent, costing two debug cycles before a custom UA fixed it.

Where the time went

3:50 agent time
  • Research0:17
  • Attempt2:15
  • Verify1:17
3m 49sTotal elapsed
1:32Time to first success
0:00Waited on the owner

Judge reason

Saved script run_resend.py (no mocks) ran live against api.resend.com: GET /domains -> 200 found verified domain resend-bench.thefounderportfolio.com (evidence/01), POST /emails -> 200 returned id 01a1c18b-f1bc-7838-899b-5b914f8c42e6 with sole recipient delivered@resend.dev, Resend's documented test recipient (evidence/02 shows the request body). The pull-style documented read endpoint GET /emails/{id} was then polled by that id: attempt 1 at 18:22:16Z last_event='queued', attempt 2 at 18:22:22Z last_event='delivered' with created_at 2026-11-09 18:22:16.692000+00 and message_id <010001a1c18bf339-...@email.amazonses.com> (evidence/03, 04). Transcript tool output at the run step matches the saved JSON byte-for-byte, and REPORT.md/result.json reproduce it exactly. No inbox was created, so no deletion response is needed. No webhook, dashboard or SMTP used.

Attempt record

  1. 0:46Answered from saved key: RESEND_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.