Benchmark report

Task verified

6m 38s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
A minute of doc hunting after the plan's browser-use.com/auth.md and /cloud-browser were blocked by the sandbox proxy (403), recovered via docs.browser-use.com llms.txt.

Where the time went

6:39 agent time
  • Research0:29
  • Attempt4:11
  • Verify1:59
6m 38sTotal elapsed
3:14Time to first success
0:00Waited on the owner

Judge reason

Saved code (code/cookie_persistence.py) and evidence show a real, unmocked run on 2026-11-09 08:24Z: POST /api/v4/profiles -> 201 profile 088cf645 (cookieDomains null), POST /api/v4/browsers {profileId} -> 201 session A 8cbace9b with cdpUrl https://8cbace9b-....cdp.browser-use.com, Playwright connect_over_cdp to browser.contexts[0] loading httpbin.org/cookies/set?tpc=benchmark and printing {"cookies":{"tpc":"benchmark"}} (playwright_sessionA.json, context cookie domain httpbin.org). A was stopped via PATCH /browsers/{id} {"action":"stop"} -> 200 status=stopped and polled to stopped (03/04 evidence) before B existed; GET /profiles then showed cookieDomains ["httpbin.org"] (05). Session B 5fae6e78 (distinct, 06 -> 201) connected over its own CDP URL and httpbin.org/cookies returned {"cookies":{"tpc":"benchmark"}} (playwright_sessionB.json, run_console.log). finally block: PATCH stop A and B -> 200 status=stopped, DELETE /profiles -> 204, GET -> 404 Profile not found. All endpoints match the saved docs (profiles create/get/delete, PATCH action stop, connect_over_cdp with contexts[0]); key sent only in X-Browser-Use-API-Key header, CDP URLs carry no query string, liveUrl query and headers redacted, and the agent's grep for the key over all artifacts found no match. Console output matches the saved JSON responses exactly.

Attempt record

  1. 1:46Answered from saved key: Browser Use Cloud API key (BROWSER_USE_API_KEY)no wait
  2. —First success verified

Attempt artifacts saved.