Benchmark report

Task verified

4m 55s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Two 404s on guessed doc paths before WebSearch found the real stop/Playwright pages, plus one PEP 668 pip failure needing a venv.

Where the time went

4:55 agent time
  • Research0:18
  • Attempt3:17
  • Verify1:20
4m 55sTotal elapsed
2:22Time to first success
0:00Waited on the owner

Judge reason

Saved code work/browser_use_session.py calls the documented POST https://api.browser-use.com/api/v4/browsers with the X-Browser-Use-API-Key header; evidence/create_session_response.json shows httpStatus 201 with id 9d0a10e8-d126-4a63-a915-2b85a7ad98d9, status active and cdpUrl https://9d0a10e8-....cdp.browser-use.com (no credential in the URL). run_output.txt from the single live run (transcript idx 63-64, EXIT=0) shows Playwright chromium.connect_over_cdp on that URL, page.url() https://example.com/ and PAGE TITLE 'Example Domain'. Termination runs in a finally block via the documented PATCH /api/v4/browsers/{id} {"action":"stop"}; stop_session_response.json shows httpStatus 200, status stopped, finishedAt 2026-11-09T10:04:27.525636Z. Printed values match the saved responses, docs fetched (create-browser-session, update-browser-session, playwright-puppeteer-selenium) confirm the operations and that no header is required on the CDP connection, and no saved file contains the key (only <REDACTED_API_KEY>/liveUrl wss redacted; agent's scan found 0 hits). Nothing mocked or hard-coded. Setup also clean: venv + pip install playwright succeeded after the system pip PEP 668 refusal.

Attempt record

  1. 1:39Answered from saved key: BROWSER_USE_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.