Benchmark report

Task verified

4m 8s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Cloudflare returned 403 error 1010 ('browser_signature_banned') to python-urllib's default user-agent, forcing a rewrite to Node with an explicit User-Agent.

Where the time went

4:09 agent time
  • Research0:15
  • Attempt2:47
  • Verify1:06
4m 8sTotal elapsed
1:46Time to first success
0:00Waited on the owner

Judge reason

Saved send_email.mjs is byte-identical to the heredoc executed in the transcript and posts to the documented endpoint POST https://api.resend.com/emails with Bearer auth. Sender was discovered live via GET /domains (HTTP 200, verified domain resend-bench.thefounderportfolio.com, capabilities.sending=enabled); recipient is Resend's documented test address delivered@resend.dev. evidence/request.json matches the code's payload exactly (subject 'Transactional test: order #A-1042 confirmed' and the plain-text body). evidence/send_response.json shows a live 200 OK with documented shape {"id":"01a19b2d-457f-7870-bf07-b34f46b40d30"} plus real Cloudflare/rate-limit headers (cf-ray a5417341fa3a1f9b-PDX, x-resend-monthly-quota 21, idempotent-replayed=false), and transcript tool output at the send step printed the same status and id. An independent GET /emails/{id} returned 200 with last_event 'delivered', matching to/from/subject/text and an SES message_id. No mocking, no SMTP, no dashboard; exactly one email sent.

Attempt record

  1. 0:27Answered from saved key: Resend API keyno wait
  2. —First success verified

Attempt artifacts saved.