[m-hu]

Supersedes #2 (fork head: pull_request runs from forks receive no secrets, so BENCHER_API_KEY always rendered empty — see discussion there). Same branch content, moved to a same-repo head so secrets flow. Session: gentle-menkar.

Fixes #1. Branch: m-hu:perf/1-callgrind. Spec: docs/1/specification.md (on this branch).

Problems

• The algorithms repo has no performance signal: JVM-vs-clojure-rs
  comparisons do not exist here, while the snippet repo has had a
  deterministic callgrind sweep with Bencher overlays since T1211.
• Four test-isolation bugs hid in the suite, invisible to the
  whole-suite runners: three namespaces use clojure.set /
  clojure.java.io without requiring them (passing only by ambient
  load order), and one test depends on stack exhaustion
  ((thrown? Throwable (power 2 -1)) with an impl that recurses
  past zero forever).

Root causes

• No sweep tooling or workflow exists in this repo (ci.yml runs
  correctness only).
• Per-namespace standalone runs (required for per-benchmark
  measurement) expose load-order dependence: karger-test,
  xor-cipher-test, and disjoint-set-test fail with
  ClassNotFoundException / Syntax error compiling on a fresh
  runtime on both legs (verified JVM fails identically — repo
  bugs, not port gaps).
• (power 2 -1) never terminates by design; the JVM surfaces
  this as a catchable StackOverflowError, while clojure-rs
  aborts the process (SIGABRT, exit 134 — port gap tracked at
  Unbounded recursion aborts the process instead of throwing a catchable StackOverflowError clojure#220).

Solutions (why each resolves its problem)

• perf/driver.clj: one driver for both legs — require the ns,
  clojure.test/run-tests, print one
  SUMMARY {:test :pass :fail :error} line. Same workload both
  legs; no System/exit (unemulated natively) — the gate reads
  stdout.
• scripts/ci/go (algoperf): vendored recipe-identical measure
  core (valgrind flags, JVM -Xint+EpsilonGC, LD_PRELOAD shim
  with byte-identical C source, BMF shape) with namespace
  discovery and the SUMMARY gate instead of full-stdout
  comparison (namespaces print nondeterministically).
• perf-callgrind.yml: resolve-rs (floats clojure-rs HEAD) +
  correctness gate + shard(8) x runtime(2) sweep + per-runtime
  merge + JVM-vs-native count-diff gate. ci.yml untouched.
• Test-isolation fixes (spec §non-goals amended — the sweep
  itself surfaced them): three missing :requires, one
  fail-fast negative-exponent guard.
• JVM locale pin (-Duser.language/country): comma-decimal
  hosts failed 13 namespaces via format-based assertions and
  would perturb Ir counts.
• Split timeouts (--timeout 1800 native / --callgrind-timeout
  600 + skip-degrade): the slowest namespace needs ~11min on
  the native leg, which must not flake the correctness gate.

No regressions

• ci.yml, deps.edn, build.clj untouched; the sweep is a new
  workflow file plus additive perf/ + scripts/ + docs/.
• The four src//test/ fixes keep full-suite semantics: the
  requires are no-ops where already loaded, and the power guard
  throws a Throwable exactly where the test asserts one
  (whole-suite clojure -M:test still the gate's precondition).
• Recipe fidelity: the C shim is md5-identical to T1211's, and
  JVM flags/parsers/BMF are line ports (only discovery, gating,
  and naming adapted — all covered by self-tests).

Test Plan

• gofmt -l clean, go vet ./..., go test ./... green
  (cmd/algoperf, internal/algocore, internal/measure).
• algoperf measure --self-test: 26/26 checks (SUMMARY,
  callgrind, shim, EpsilonGC, GNU-time parsers; templates;
  leg/skip classifiers).
• python3 -c yaml.safe_load on the workflow + action;
  git diff --check clean.
• Native e2e (--only, 3 namespaces): gate passes, report +
  BMF + summary outputs verified by shape.
• JVM e2e incl. EpsilonGC alloc path (alloc_min=59430912B
  on one namespace).
• --merge verified (dedupe + counts + summary render).
• Full 1351-namespace sweeps, timed phase, both legs:
  1351 ok / 0 failed each; cross-leg counts match except
  the 2 documented random-graph namespaces (karger,
  random-graph-generator), whose :pass variance is
  normalized in report-compare (proven the only varying
  ones over the full 1351x2 data).
• CI (Linux) remains the proof for the valgrind/shim paths
  (no valgrind on this host) — same as T1211.

Housekeeping notes

• Branch commits predate the AI-Tool: trailer convention on
  this repo (pushed; not rewritten per policy) — attribution
  rides this PR body into the squash instead. New commits on
  this branch will carry the trailer.
• Draft until the admin step lands (below).

Admin needed (repo admin)

• Create Bencher project clojure-algorithms, set
  BENCHER_API_KEY secret (Bencher steps fail without it).
• Optionally require the new checks in branch protection
  after first green.

Session: gentle-menkar.

AI-Tool: Muse Code 1.4.14-R7309.1 (Meta Muse Spark)

[github-actions]

Bencher Report

Project	clojure-algorithms
Branch	perf/1-callgrind
Commit	15824e1

Report	Testbed	Adapter	Status
1	ubuntu-latest-clojure-rs	JSON	✅ No Alerts
2	ubuntu-latest-jvm	JSON	✅ No Alerts

⚠️ WARNING: Truncated view!

The full continuous benchmarking report exceeds the maximum length allowed on this platform.

[michael-h-hu]

Session: gentle-menkar. Approving.

Verified on exact HEAD 15824e1: CI run green (after a pre-existing affine-test flake, tracked as #4, cleared on rerun); perf-callgrind run 21/21 success with Bencher uploads proven (338 report URLs in the sampled shard log — ~170 benchmarks x 2 measures as designed). Sweeps: all 16 shards green on both legs. Secrets flow correctly on this same-repo head (the fork-head #2 failure mode is documented there and does not apply). Branch is mergeable, no conflicts. Design reviewed during implementation (SUMMARY gate, count-diff rule, locale pin, threshold policy). Landing approved.