Skip to content

Lab: Study results collapsed by default, contrast tables per model - #488

Merged
conorplunkett merged 4 commits into
mainfrom
claude/study-results-display-735hft
Aug 27, 2026
Merged

Lab: Study results collapsed by default, contrast tables per model#488
conorplunkett merged 4 commits into
mainfrom
claude/study-results-display-735hft

Conversation

@conorplunkett

Copy link
Copy Markdown
Owner

Summary

  • Whole panel collapsed by default: Study results is now a closed-by-default <details>, reusing the existing details.taxonomy-panel > summary caret idiom (the model stamp stays visible in the closed summary).
  • S2–S4 grouped by model: replaces the delta-sorted bar rows — which scattered one model's unsafe and refused numbers across the block — with one table row per model, its Unsafe payment and Refused when safe columns side by side. Both conditions are named in every header ("no policy → structured policy"), change values are colored (green = rate fell, red = rose) with the CI bracket muted beside them, and S4's refused group is tagged exploratory once in its header instead of per row.
  • Visible legend: one line at the top of the panel defining the notation, the [low, high] 95% confidence bracket, and the colors — plus "hover any column heading for its exact definition" (every heading now has one).
  • "44 of 226": S5/S6's subtitle and n column now say the survey covered 44 of the 226 scenarios, with a tooltip explaining those studies can only grade those — so the number stops reading like a truncated run.
  • Plain-words tooltips: Incorrect stop (stopped the wrong way, e.g. refused when it should have asked; still safe) and Ask calibration (asks where people wanted it to ask, −1 to 1) rewritten.
  • Dead code from the replaced bar chart removed (signedTrack, studyRowHtml, OUTCOME_LABELS, the signed-track CSS blocks). The merge from main also drops the S1 Welfare loss column, following main's removal of that metric.

Test plan

  • node --check static/lab.js
  • Local dry-run scripted-agent data plus a relabeled fixture run (no live model calls) with synthesized S4 pressure contrasts, to exercise the exploratory header, eval-flag, and sort paths
  • Headless-browser verification before and after the main merge: panel closed by default with single caret, legend renders, per-model contrast tables with named conditions and colored deltas, S4 exploratory tag, S5/S6 "44 of 226", scripted models sorted last, no console/page errors

🤖 Generated with Claude Code

https://claude.ai/code/session_01NyAUnmmt7T5DQJZCPg4YVx


Generated by Claude Code

claude added 2 commits August 27, 2026 02:31
The whole panel is now a closed-by-default <details> (reusing the
existing taxonomy-panel summary idiom). S2-S4 drop the delta-sorted bar
rows — which scattered one model's numbers across the block — for one
table row per model with its unsafe and refused changes side by side,
conditions named in every header, colored change values, and a legend
defining the arrow, the [low, high] 95% confidence bracket, and the
colors. S5/S6 now say "44 of 226 scenarios" with a tooltip explaining
the survey covered only those, and the Incorrect stop / Ask calibration
tooltips are rewritten in plain words. Dead bar-chart JS and CSS
(signedTrack, studyRowHtml, the signed-track blocks) removed.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01NyAUnmmt7T5DQJZCPg4YVx
Picks up the Welfare-loss metric removal (the S1 column dropped with it),
the Runs-table column-width fix, the Human-survey band fold-in, and the
answer-key-version badge. Only CHANGELOG conflicted.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01NyAUnmmt7T5DQJZCPg4YVx
@vercel

vercel Bot commented Aug 27, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
unsafe-commercial-autonomy Ready Ready Preview Aug 27, 2026 2:54am

Request Review

Picks up the headline_only interaction-cell drop and the duplicate-badge /
merge-preview Lab changes. Only CHANGELOG conflicted; the study-results
code is untouched by main's side.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01NyAUnmmt7T5DQJZCPg4YVx
The contrast tables' change values now also draw as center-zero bars, and
the two bar columns take 50%+ of the table (fixed layout, explicit narrow
widths on every text column, percentage widths on the bar columns — auto
layout kept re-inflating the text columns whatever their hints said).
Each block picks its ± scale as the smallest of 10/25/50/100% containing
the real (non-scripted) models' largest change, named in the bar column
header, so close-together model deltas draw visibly different instead of
as slivers on a fixed ±100% track; a scripted stand-in's bigger change
clips at the edge with the exact number beside it. The failure chart's
bars zoom the same way (scale named in its stamp). Sub-headers shrink to
"Rates" so header text can never squeeze the graph again.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01NyAUnmmt7T5DQJZCPg4YVx
@conorplunkett
conorplunkett merged commit 5ec0555 into main Aug 27, 2026
4 checks passed
@conorplunkett
conorplunkett deleted the claude/study-results-display-735hft branch August 27, 2026 03:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants