Repository navigation
docs: the resume line led with a p99 that was stale and mislabelled - #63
Merged
Merged
Conversation
PLAN.md's resume line opened with "p99 37 us ingest-to-signal on recorded live sessions". That number was wrong in two independent ways. It had drifted. The same committed captures measure 74 to 78 us today, and docs/bench/latency.md was updated to 77.5 while this line and soak.md's cross-reference were not. More seriously, it is a SERVICE time. latency.md's entire finding is that the service p99 understates what a consumer actually waits by 13.3x, so a resume line leading with an unqualified service p99 contradicts the repo's own headline result. The finding now replaces the figure, and it is the better line: anyone can report a percentile, and almost nobody reports catching their own benchmark flattering itself. Also swapped 2.19M messages/sec for ~2M, since 2.19 was a best-of-five and today's five runs span 1.80 to 1.90 on a busier machine - the ratio against the venue's 269 is what carries the point, not the third digit. soak.md's "p50 0.5 us, p99 37 us" cross-reference gets the same treatment, plus a note that the agreement between the two captures is the durable claim and the absolute figures move with the machine.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PLAN.md's resume line opened with "p99 37 us ingest-to-signal on recorded live sessions." That number was wrong in two independent ways.1. It had drifted
The same committed captures measure 74–78 µs today.
docs/bench/latency.mdwas updated to 77.5; this line andsoak.md's cross-reference were not.2. It's a service time, and the repo's headline says so
latency.md's entire finding is that the service p99 understates what a consumer waits by 13.3x. A resume line leading with an unqualified service p99 contradicts the repo's own strongest result.The finding now replaces the figure:
That's the better line anyway. Anyone can report a percentile; almost nobody reports catching their own benchmark flattering itself.
Also
soak.md's stale cross-reference fixed, with a note that the agreement between the two captures is the durable claim and the absolute figures move with the machine.