Skip to content

[operations] docs: add runbook for ACMM Level Monitor failure-alert gap - #23236

Open
kubestellar-hive[bot] wants to merge 1 commit into
mainfrom
operations/acmm-level-monitor-no-alert
Open

[operations] docs: add runbook for ACMM Level Monitor failure-alert gap#23236
kubestellar-hive[bot] wants to merge 1 commit into
mainfrom
operations/acmm-level-monitor-no-alert

Conversation

@kubestellar-hive

Copy link
Copy Markdown
Contributor

Summary

Issue #23235 identified that .github/workflows/acmm-level-monitor.yml ("ACMM Level
Monitor") has no failure-alerting mechanism for the case where the job itself fails
to execute (as opposed to running successfully and reporting a genuine or
false-positive regression — that separate case is tracked in #23233 and is not
touched by this PR). It has no if: failure() step and is not listed in
.github/workflows/workflow-failure-issue.yml's workflow_run catch-all.

This PR adds docs/runbooks/acmm-level-monitor-no-alert.md, a runbook documenting
the gap, a manual gh run list detection command, and the proposed one-line fix
(add "ACMM Level Monitor" to the catch-all's workflows: list) for a maintainer
with workflows permission to apply. It also links the new runbook from
docs/README.md's operator index.

Why no CI config file change

The operations agent's GitHub App token lacks the workflows permission required
to create or update files under .github/workflows/, confirmed in multiple prior
sessions (see docs/runbooks/upgrade-smoke-no-alert.md,
docs/runbooks/console-live-promote-no-alert.md,
docs/runbooks/stale-workflow-no-alert.md). This PR documents the interim
manual-detection workaround and the proposed fix for a maintainer with that
permission to apply.

Scope

Docs-only change: one new runbook file, one README index entry. No CI
configuration, code, or automation behavior is modified.

Refs #23235.

— hive: agent=operations backend=copilot model=claude-sonnet-5

acmm-level-monitor.yml has no if: failure() step and is not listed in
workflow-failure-issue.yml's catch-all, so a job execution failure
(distinct from the endpoint-unreachable false positive tracked in
#23233) produces no notification. Adds a runbook documenting manual
detection and the proposed catch-all fix, and links it from the
docs/README.md operator index.

Refs #23235.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: operations-agent <operations-agent@users.noreply.github.com>
@kubestellar-hive kubestellar-hive Bot added the hold Blocked — do not touch label Sep 6, 2026
@kubestellar-hive

Copy link
Copy Markdown
Contributor Author

Important

Held for human sign-off on the direction, not on the code.

This PR's only tracked rationale is #23235, which the hive filed itself — issue #23235 was filed by kubestellar-hive[bot] and no human has acknowledged it. An agent-filed issue does not, on its own, establish that anyone agreed to the direction (hivecommons/hive#5117).

The change may well be right; nothing here is a review of it. To release the hold, acknowledge the direction on that issue — comment on it, assign yourself, or add the approved-direction label — and remove the hold label here.

@kubestellar-prow kubestellar-prow Bot added the dco-signoff: yes Indicates the PR's author has signed the DCO. label Sep 6, 2026
@netlify

netlify Bot commented Sep 6, 2026

Copy link
Copy Markdown

Deploy Preview for kubestellarconsole canceled.

Name Link
🔨 Latest commit b443666
🔍 Latest deploy log https://app.netlify.com/projects/kubestellarconsole/deploys/6a9deb0fe16cf3000898b3b4

@kubestellar-prow

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign mikespreitzer for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@github-actions

github-actions Bot commented Sep 6, 2026

Copy link
Copy Markdown
Contributor

👋 Hey @kubestellar-hive[bot] — thanks for opening this PR!

🤖 This project is developed exclusively using AI coding assistants.

Please do not attempt to code anything for this project manually.
All contributions should be authored using an AI coding tool such as:

This ensures consistency in code style, architecture patterns, test coverage,
and commit quality across the entire codebase.


This is an automated message.

@github-actions github-actions Bot added the ai-generated Pull request generated by AI label Sep 6, 2026
@kubestellar-prow kubestellar-prow Bot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Sep 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-generated Pull request generated by AI dco-signoff: yes Indicates the PR's author has signed the DCO. hold Blocked — do not touch size/M Denotes a PR that changes 30-99 lines, ignoring generated files. tier/0-automatic

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants