Skip to content

[codex] Guardrail backlog: Release train drift (release-train-drift) #71

@haasonsaas

Description

@haasonsaas

Release train drift

This issue tracks a recurring review-feedback class from the EvalOps review feedback sentinel.

  • Class: release-train-drift
  • Score: 80
  • Findings: 1
  • Repos: evalops/deploy
  • Generated at: 2026-05-22T07:33:46Z
  • Window: merged since 2026-05-19 with minimum severity high

Guardrail to build

Add release metadata and changelog coverage checks tied to the package or deploy artifact that changed.

Representative feedback

  • p1 evalops/deploy#4193 top-level feedback
    • Follow-up: addressed the P1 BigQuery schema migration review. The new queue telemetry fields now append to internal_runner_diagnostics_raw.json instead of being inserted before failure_count, matching BigQuery existing-table schema update rules. Added a regression test for the append-only field order and reran focused diagnostics tests.
    • https://github.com/evalops/deploy/pull/4193#issuecomment-4514064507

Finding fingerprints

  • 89ca762db2afde940bdf5e935b06186617049ccfd3c827ca20404e7615184b59

Acceptance criteria

  • The class has an owner repo and a concrete guardrail location.
  • The guardrail fails for at least one representative feedback shape listed above.
  • The guardrail is wired into the smallest relevant CI or preflight target.
  • The issue is closed only after the guardrail has merged and the feedback sentinel no longer ranks this class as an unaddressed candidate.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions