[dustinbyrne]

Changes

Stacked on the Python benchmark producer PR #1134.

• Invoke the shared harness action in offline render mode inside the existing read-only benchmark job. Upload rendered comparisons separately from the three-file raw artifact.
• Add a separate default-branch workflow_run consumer using the shared trusted publishing workflow. No SDK/PR code executes in the writable job.
• Pin the harness action and shared workflow to real published immutable commits and document activation/measurement semantics.

Dependencies:

• feat: add shared SDK benchmark reporting posthog-sdk-test-harness#93 (a558711336bd3b81be4a820ed10f26372fc568ed)
• ci: add trusted SDK benchmark report workflow .github#84 (ced4b9694b90c9221bc277b1c8d9f013eafe56c5)

Both shared components and this caller configuration need normal review. Automatic PR comments activate only after the workflow_run caller lands on the default branch; summaries can render on this PR already.

Validation

• Actionlint, immutable-pin/path verification through GitHub, and diff checks passed.
• Real Node/Python result pairs rendered using the shared action code.
• Shared harness: 185 focused tests; full suite 1,501 passed / 502 skipped. Shared workflow: five boundary/pin checks and 40 existing tests passed.
• Fresh integrated read-only review covered this wiring and the shared implementation.

CI/tooling only; no SDK runtime, workload, or release changes in this layer. Performance differences remain informational.

Agent context

Autonomy: Human-driven (agent-assisted).
Implemented with Pi and reviewed independently. The stack keeps producer measurements separate from shared reporting integration.

[stamphog]

Not approved — this change needs a human reviewer.

Re-adding the stamphog label gives the same result unless the changed files change.

stamphog can't auto-review this pull request because two policy gates refused it. The deny-list gate flagged it as infra/CI/CD, since it adds .github/workflows/benchmark-report.yml and changes .github/workflows/benchmarks.yml. The tier gate classified it as T2-never (47 lines, 3 files, two areas, CI), a category that is never handled automatically. The size gate passed, so splitting the change wouldn't clear the refusal. Workflow changes need a human reviewer, so please ask a maintainer or the owners of the CI configuration to review it.

Gate mechanics and policy version

Gate		Result
prerequisites	✓	all clear
deny-list	✗	matches: infra_cicd
size	✓	41L, 2F substantive, 47L/3F incl. docs/generated/snapshots — within ceiling
tier	✗	classified as T2-never: T2-never (47L, 3F, two-areas, ci)
stamphog 2.6.1		.stamphog/policy.yml @ unknown · reviewed head 9d5ad57

[posthog]

PostHog Review · Standard · reviewed 9d5ad57: 1 Should fix.

See this review and its findings in PostHog Review. Comment @posthog review --deep for a Deep review. A Deep review takes longer and looks deeper than a Standard review.

[posthog]

P2 · Isolate publisher concurrency across pull requests

When three PR benchmark runs finish while a publisher remains active, the pinned workflow puts all reports in the same repository-wide concurrency group. GitHub replaces the pending job even with cancel-in-progress: false, so an unrelated PR loses its comment without a retry. Update the shared workflow pin after scoping concurrency per PR with a fork-safe fallback.

[github-actions]

posthog-python Compliance Report

Date: 2026-10-27T23:24:27.214999+00:00
Duration: 259700ms

✅ All Tests Passed!

121/121 tests passed

---

Capture_V1 Tests

✅ 95/95 tests passed

View Details

Test	Status	Duration
Endpoint And Method.Targets V1 Endpoint	✅	515ms
Endpoint And Method.Does Not Use Legacy Endpoints	✅	510ms
Required Headers.Has Authorization Bearer Header	✅	509ms
Required Headers.Has Content Type Json	✅	509ms
Required Headers.Has Posthog Sdk Info Format	✅	509ms
Required Headers.Has Posthog Attempt Header	✅	509ms
Required Headers.Has Posthog Request Id	✅	509ms
Required Headers.Has Posthog Request Timestamp	✅	509ms
Required Headers.Has User Agent	✅	509ms
Body Format.Body Has Created At And Batch	✅	508ms
Body Format.No Api Key In Body	✅	509ms
Body Format.No Sent At In Body	✅	509ms
Event Format.Event Has Required Root Fields	✅	508ms
Event Format.Event Uuid Is Valid	✅	510ms
Event Format.Event Timestamp Is Rfc3339	✅	509ms
Event Format.Non Utc Event Timestamp Is Converted To Utc	✅	521ms
Event Format.Distinct Id Is String	✅	508ms
Event Format.Distinct Id At Root Not Properties	✅	509ms
Event Format.Custom Properties Preserved	✅	509ms
Event Format.Set Properties Preserved	✅	509ms
Event Format.Set Once Properties Preserved	✅	508ms
Event Format.Groups Properties Preserved	✅	509ms
Event Format.Sdk Generates Uuid If Not Provided	✅	509ms
Event Format.Event Has Required Root Fields Batch	✅	512ms
Event Format.Event Uuid Is Valid Batch	✅	512ms
Event Format.Event Timestamp Is Rfc3339 Batch	✅	512ms
Event Format.Distinct Id Is String Batch	✅	512ms
Event Format.Distinct Id At Root Not Properties Batch	✅	513ms
Event Format.Custom Properties Preserved Batch	✅	512ms
Event Format.Set Properties Preserved Batch	✅	512ms
Event Format.Set Once Properties Preserved Batch	✅	513ms
Event Format.Groups Properties Preserved Batch	✅	512ms
Event Format.Sdk Generates Uuid If Not Provided Batch	✅	512ms
Batch Behavior.Multiple Events In Single Batch	✅	516ms
Batch Behavior.Batch Envelope Smoke	✅	514ms
Batch Behavior.Flush With No Events Sends Nothing	✅	505ms
Batch Behavior.Flush At Triggers Batch	✅	1011ms
Batch Behavior.Created At Reflects Batch Creation Time	✅	509ms
Deduplication.Generates Unique Uuids	✅	515ms
Deduplication.Different Events Same Content Different Uuids	✅	511ms
Deduplication.Preserves Uuid On Retry	✅	6514ms
Deduplication.Preserves Timestamp On Retry	✅	6517ms
Deduplication.Preserves Uuid And Timestamp On Batch Retry	✅	6521ms
Deduplication.No Duplicate Events In Batch	✅	518ms
Header Behavior On Retry.Attempt Header Starts At One	✅	509ms
Header Behavior On Retry.Attempt Header Increments On Retry	✅	13517ms
Header Behavior On Retry.Request Id Preserved On Retry	✅	6519ms
Header Behavior On Retry.Different Requests Have Different Request Ids	✅	3017ms
Header Behavior On Retry.Request Timestamp Changes On Retry	✅	6517ms
Response Format Validation.Success Response Has Uuid Keyed Results	✅	510ms
Response Format Validation.Success Response Has Ok For Each Event	✅	514ms
Response Format Validation.Success No Retry After When All Ok	✅	511ms
Response Format Validation.Success Retry After Present When Retry Events	✅	1513ms
Response Format Validation.Success No Retry After When Drop Only	✅	511ms
Response Format Validation.Response Echoes Request Id	✅	509ms
Retry Behavior.Retries On 408	✅	6517ms
Retry Behavior.Retries On 500	✅	6515ms
Retry Behavior.Retries On 503	✅	8516ms
Retry Behavior.Retries On 504	✅	6518ms
Retry Behavior.Retryable Errors Have Retry After	✅	3514ms
Retry Behavior.Respects Retry After On Retryable Error	✅	11521ms
Retry Behavior.Does Not Retry On 400	✅	2511ms
Retry Behavior.Does Not Retry On 401	✅	2512ms
Retry Behavior.Does Not Retry On 402	✅	2512ms
Retry Behavior.Does Not Retry On 413	✅	2513ms
Retry Behavior.Does Not Retry On 415	✅	2511ms
Retry Behavior.Non Retryable Errors Have No Retry After	✅	2512ms
Retry Behavior.Implements Backoff	✅	22533ms
Retry Behavior.Max Retries Respected	✅	22534ms
Partial Batch Handling.Handles 200 Full Success	✅	2511ms
Partial Batch Handling.Handles 200 With All Ok	✅	3514ms
Partial Batch Handling.Does Not Retry Dropped Events	✅	3515ms
Partial Batch Handling.Does Not Retry Limited Events	✅	3514ms
Partial Batch Handling.Prunes Ok Events On Partial Retry	✅	6519ms
Partial Batch Handling.Prunes Dropped Events On Partial Retry	✅	6521ms
Partial Batch Handling.Retries Only Retry Events From Partial	✅	6517ms
Partial Batch Handling.Partial Retry Preserves Uuids	✅	6521ms
Partial Batch Handling.Partial Retry Attempt Header Increments	✅	6520ms
Partial Batch Handling.Partial Retry Request Id Preserved	✅	6517ms
Partial Batch Handling.Respects Retry After On Partial	✅	8515ms
Partial Batch Handling.Unknown Result Treated As Terminal	✅	3516ms
Partial Batch Handling.Mixed Ok Drop Limited No Retry	✅	3516ms
Compression.Sends Gzip Content Encoding	✅	510ms
Compression.No Content Encoding When Disabled	✅	508ms
Compression.Compressed Body Is Decompressible	✅	509ms
Error Handling.Does Not Retry On Unknown 4Xx	✅	2511ms
Event Options.Cookieless Mode Override	✅	509ms
Event Options.Disable Skew Correction Override	✅	509ms
Event Options.Process Person Profile Override	✅	508ms
Event Options.Product Tour Id Override	✅	509ms
Event Options.Unset Options Omitted	✅	509ms
Event Options.Options Override In Batch	✅	512ms
Geoip And Historical Migration.Geoip Disable Injected Into Properties	✅	509ms
Geoip And Historical Migration.Historical Migration Set In Body	✅	509ms
Geoip And Historical Migration.Historical Migration Absent By Default	✅	508ms

Capture_Ai Tests

✅ 5/5 tests passed

View Details

Test	Status	Duration
Routing.Capture Ai Posts To Ai Endpoint	✅	509ms
Routing.Capture Does Not Reroute Ai Named Events	✅	509ms
Identity.Capture Ai Event Has Uuid	✅	509ms
Identity.Capture Ai Keeps Supplied Uuid	✅	509ms
Timestamp Format.Non Utc Event Timestamp Is Converted To Utc	✅	509ms

Feature_Flags Tests

✅ 17/17 tests passed

View Details

Test	Status	Duration
Request Payload.Request With Person Properties Device Id	✅	10ms
Request Payload.Flags Request Uses V2 Query Param	✅	9ms
Request Payload.Flags Request Hits Flags Path Not Decide	✅	9ms
Request Payload.Flags Request Omits Authorization Header	✅	10ms
Request Payload.Token In Flags Body Matches Init	✅	8ms
Request Payload.Groups Round Trip	✅	9ms
Request Payload.Groups Default To Empty Object	✅	10ms
Request Payload.Disable Geoip False Propagates As Geoip Disable False	✅	8ms
Request Payload.Disable Geoip Omitted Defaults To False	✅	9ms
Request Payload.Flag Keys To Evaluate Contains Only Requested Key	✅	9ms
Request Lifecycle.No Flags Request On Init Alone	✅	4ms
Request Lifecycle.No Flags Request On Normal Capture	✅	509ms
Request Lifecycle.Two Flag Calls Produce Two Remote Requests	✅	14ms
Request Lifecycle.Mock Response Value Is Returned To Caller	✅	9ms
Retry Behavior.Retries Flags On 502	✅	311ms
Retry Behavior.Retries Flags On 504	✅	312ms
Side Effect Events.Get Feature Flag Captures Feature Flag Called Event	✅	511ms

Feature_Flags_Local_Evaluation Tests

✅ 4/4 tests passed

View Details

Test	Status	Duration
Versioned Boolean Matching.Matching Version Missing	✅	66ms
Versioned Boolean Matching.Matching Version 1	✅	67ms
Versioned Boolean Matching.Matching Version 2	✅	66ms
Versioned Boolean Matching.Version Only Reload 1 2 1 2 Missing	✅	33ms