Benchmark report

Task verified

5m 29s elapsed

The saved attempt met the documented success criterion.

Experience score

90/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • SDocs
  • BCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs S, Current BSInstallAAuthSExecuteSDocsBCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Resend's misleading HTTP 422 'already registered' on every example.* name (plus the 403 code 1010 UA block) forced extra probing and a documented domain-name fallback.

Where the time went

5:30 agent time
  • Research0:20
  • Attempt3:09
  • Verify2:01
5m 29sTotal elapsed
1:57Time to first success
0:00Waited on the owner

Judge reason

Saved code (resend-domain-task/verify_domain.py, stdlib urllib against https://api.resend.com with Bearer key read from a private file) and raw evidence show the full documented Domains lifecycle executed live: POST /domains -> HTTP 201 id fbac91ec-c73f-48c2-bf28-e9ed14dc9299 (01b-create-domain.json); GET /domains/{id} -> 200 with 4 DNS records, all printed with type/name/value in run-output.txt and REPORT.md (DKIM TXT resend._domainkey.tpc-bench-ad8fea29, MX send.* feedback-smtp.us-east-1.amazonses.com prio 10, TXT send.* v=spf1 include:amazonses.com ~all, CNAME rsend.* send.forge.rmta.net); POST /domains/{id}/verify -> 200; GET status read back -> 'pending' (no verified claim anywhere, result.json sets verified_claim=false); DELETE -> 200 {"deleted":true}; follow-up GET -> 404 not_found; list afterwards shows no tpc-bench domains. No dashboard, SMTP, mock or hard-coded response. One documented deviation forced by the product: Resend rejects tpc-bench-<hex>.example.com/.net/.org with HTTP 422 'This domain has been registered already' (01-create-domain-example.com.json plus curl probes in the transcript), so the same tpc-bench-ad8fea29 label was registered under the account's own parent domain; the rejection is preserved as evidence and the deviation is disclosed in REPORT.md and result.json. Every success criterion (create+id, records listed, verify called, status read back as pending, deletion response shown, API-only) is supported by saved responses.

Attempt record

  1. 0:39Answered from saved key: RESEND_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.