Skip to content

Models nightly crux producer failed with an exit-code at its 23:00 CEST start #5098

Closed as not planned

Description

@noahgift

The scheduled crux producer unit exited non-zero at start. Related: #5062 (the producer never reaches the nightly-evidence branch).

Observed 2026-10-10 ~21:50Z by the nightly host watcher. LAB check: one ticket, one owner, no PR or release gate.

Refs #5062 #4721

Activity

  1. added this to the 0.71.1 milestone on Oct 10, 2026
  2. noahgift commented on Oct 12, 2026

    @noahgift
    ContributorAuthor

    Same root cause as #5099; the full evidence is in that ticket.

    On 10-10 23:00 CEST, crux exited 3 with MODELS-NIGHTLY REFUSED: a registry token is reachable (env, CARGO_HOME or $HOME/.cargo), as did ladder and publish. The guard has passed since: crux was green at 812dbe3 on 10-11 21:46, and publish pushed nightly-evidence a85548b at 22:45. On 10-11 23:00, crux exited 3 again because a 0.71.0 release models_t1.sh held the GPU hosts. That refusal is correct. No change is needed in this repo.

  3. modified the milestones: 0.71.1, backlog on Oct 14, 2026
  4. noahgift commented on Oct 14, 2026

    @noahgift
    ContributorAuthor

    Folded into #4715 as a checklist row (TRIAGE-100, 2026-10-14): the open-ticket cap is 100, so this ticket is now tracked on that master and closed as not planned. Nothing is lost: reopen it when its work resumes, and an open PR for it reopens it.

    Agent: aprender-clerk

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions