Benchmark report

Task verified

2m 57s elapsed

The saved attempt met the documented success criterion.

Experience score

90/ 100

Agent-Ready
  • SInstall
  • SAuth
  • AExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute A, Docs S, Current SSInstallSAuthAExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Cloudflare in front of api.resend.com returned 403 (error 1010) to urllib's default User-Agent, costing one failed script run until an explicit UA header was set.

Where the time went

2:58 agent time
  • Research0:17
  • Attempt1:32
  • Verify1:08
2m 57sTotal elapsed
0:58Time to first success
0:00Waited on the owner

Judge reason

Saved code resend-task/send_email.py does POST https://api.resend.com/emails with Bearer auth read at runtime from the key file supplied by benchmark-request (transcript idx 4-5, outcome 'provided'). Sender was discovered live via GET /domains -> HTTP 200 with verified domain resend-bench.thefounderportfolio.com (curl headers at idx 16 and evidence/domains_response.json), and the from address was built from that response, not hard-coded. Recipient is Resend's documented test address delivered@resend.dev only. The request body in evidence/send_email_response.json (subject 'Benchmark transactional email' plus the plain-text body) matches the literals in the code exactly. Live response: HTTP 200 with documented shape {"id":"01a19b1c-b9ed-7917-b74a-7d7cc8aa5df7"}, accompanied by genuine Cloudflare/Resend headers (cf-ray a54158c918ed3d49-PDX, Ratelimit-Remaining 8, X-Resend-Monthly-Quota 20) that the script captured from resp.headers at runtime. Printed status and id in evidence/send_email_stdout.txt (teed from the actual run, transcript idx 25-26) match the saved response and the final report. Exactly one send, via REST API, no SMTP, dashboard or mocking.

Attempt record

  1. 0:32Answered from saved key: Resend API keyno wait
  2. —First success verified

Attempt artifacts saved.