Benchmark report

Task verified

8m 15s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Self-inflicted bash bugs (SIGPIPE exit 141, unbound HTTP_CODE) plus Neon's undocumented free-plan org_id requirement (HTTP 400) cost three script reruns.

Where the time went

8:15 agent time
  • Research0:22
  • Attempt5:46
  • Verify2:07
8m 15sTotal elapsed
3:18Time to first success
0:00Waited on the owner

Judge reason

Saved code (work/lib.sh, stage1_create_branch_verify.sh, stage2_cleanup.sh) and raw responses show the full task executed against the live Neon API. POST /api/v2/projects -> HTTP 201 created tpcbench-20261110015111-42c622 (falling-shape-87291405, default branch br-round-cloud-ar3xeaij); psql over sslmode=verify-full&sslrootcert=system created items with 2 rows (out/02,03). The documented branch endpoint POST /projects/{id}/branches with branch.parent_id -> HTTP 201 returned br-billowing-mud-arbvenaa with parent_lsn 0/1970230 and init_source parent-data (out/04), i.e. a copy-on-write branch, not a copy; out/05 shows it already held the parent's 2 rows, so no not-inherited citation was needed. out/06 ALTER TABLE + INSERT 0 1 on the branch only, and out/07 shows child (neon.branch_id br-billowing-mud-arbvenaa) with columns id,name,note and 3 rows vs parent (br-round-cloud-ar3xeaij) with id,name, parent_has_note_column=f, 2 rows. TLS evidenced by the saved URIs plus psql \conninfo 'SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384)' on both direct endpoints and a negative control where a bogus sslrootcert fails with 'certificate verify failed' (out/08); pg_stat_ssl ssl=f is the expected proxy artifact. Cleanup: DELETE branch -> 200 then GET -> 404 'branch not found' and branch list shows only main (out/11-13); DELETE project -> 200 then GET -> 404 'project not found' and the org list has no tpcbench- project (out/14-16). Grep over out/, work/ and the transcript finds no API key, role password or password-bearing URI; every artifact is redacted by the jq redactor in lib.sh.

Attempt record

  1. 0:35Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.