Repository navigation
feat: publish native iOS and macOS benchmark pilots - #3687
Merged
Merged
Conversation
Collaborator
Author
|
Fresh independent review is clear at f90d832: issue, exporter acceptance/hash checks, provenance, tests, guidance, and presentation reviewed; 10 exporter tests and 1 presentation test passed independently. Desktop and 390px mobile rendering were visually checked, including expanded proof. Native Android remains withheld until an accepted pair is available. |
janicduplessis
marked this pull request as ready for review
October 13, 2026 12:38
Collaborator
Author
|
Windows CI hit an unchanged PowerShell detached-entry startup timeout (tracked in #3688). Retrying the failed job on the same reviewed head; no implementation changed. The Node 22/24 checks passed. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
The website shows React Native results but omits the completed standalone native pilots. Add the accepted Luna / Stim 1.20.2 comparisons for native iOS and macOS. Fixes #3684.
Solution
A separate section reports complete task time: iOS 170 s with Stim versus 307 s control, and macOS 71 s versus 145 s. Each is explicitly one pilot pair, including retries and proof capture, with expandable environment details and verified screenshots. These results do not enter the React Native Settings-ready charts or claim a general compiler speedup.
The exporter rejects unaccepted, mismatched, or modified evidence and incomplete cleanup. It emits only public metadata and selected proof images. Native Android is supported by the exporter and view but stays unpublished until an accepted pair exists.
Test plan