Skip to content

fix(machinery): drop the openebs Loki/MinIO/Alloy stack from machinery clusters - #1102

Merged
patrick-hermann-sva merged 1 commit into
mainfrom
fix/machinery-openebs-observability
Aug 11, 2026
Merged

patrick-hermann-sva merged 1 commit into
mainfrom
fix/machinery-openebs-observability

Conversation

@patrick-hermann-sva

@patrick-hermann-sva patrick-hermann-sva commented Aug 11, 2026 •

Copy link
Copy Markdown
Contributor

The openebs chart ships an observability stack enabled by default: a Loki StatefulSet, the MinIO StatefulSet backing it, an Alloy DaemonSet, and two extra StorageClasses. The localpv profile this play uses disables the lvm/zfs/mayastor engines but left all of that on, so every machinery cluster ran seven pods of logging nobody asked for.

On a 1+2 kind cluster — which is what every machinery cluster is — it cannot even run. Loki asks for three replicas with pod anti-affinity: the two workers take replicas 1 and 2, the control-plane node is tainted, and replica 0 sits Pending forever. u26-kind3 carried that permanently non-Running pod from the day it was built, and kind1 has the same one.

Notes

  • MinIO has no toggle of its own — it is Loki's object store and a sub-dependency, so loki.enabled=false is what removes it.
  • Alloy goes too: a log shipper with no Loki ships logs at nothing.
  • openebs-hostpath is untouched — that is the StorageClass everything here actually uses.

Shape change

To pass the toggles, pre_crossplane_helmfiles entries become dicts with an optional state_values map rendered into --state-values-set. A plain string still works (item.location | default(item)), so a caller overriding the list is unaffected.

Dependency

Requires stuttgart-things/helm#155, which adds the state values — defaulting to true there, so nothing outside this play changes. Against an older helmfile the flags are simply ignored and the stack stays up.

Verification

On u26-kind3, after the run:

before after
pods in openebs 9 (incl. openebs-loki-0 Pending) 1 (openebs-localpv-provisioner)
StorageClasses openebs-hostpath, openebs-loki-localpv, openebs-minio-localpv, standard openebs-hostpath, standard
non-Running pods cluster-wide 1 0

The three MinIO StatefulSet PVCs survive a Helm removal (volumeClaimTemplates are not Helm-managed) and were deleted separately.

Follows #1098 and #1101.

🤖 Generated with Claude Code

https://claude.ai/code/session_01FSYX5dsdVdzLCuB6xYhaLK

…y clusters

The openebs chart ships an observability stack enabled by default: a Loki
StatefulSet, the MinIO StatefulSet backing it, an Alloy DaemonSet, and two extra
StorageClasses. The localpv profile this play uses disabled the lvm/zfs/mayastor
engines but left all of that on, so every machinery cluster ran seven pods of
logging nobody asked for.

On a 1+2 kind cluster — which is what every machinery cluster is — it cannot
even run. Loki asks for three replicas with pod anti-affinity: the two workers
take replicas 1 and 2, the control-plane node is tainted, and replica 0 sits
Pending forever. u26-kind3 carried that permanently non-Running pod from the day
it was built, and kind1 has the same one.

MinIO has no toggle of its own — it is Loki's object store and a sub-dependency,
so loki.enabled=false is what removes it. Alloy goes too, since a log shipper
with no Loki ships logs at nothing. openebs-hostpath, the StorageClass
everything here actually uses, is untouched.

To pass the toggles, pre_crossplane_helmfiles entries become dicts with an
optional state_values map rendered into --state-values-set. A plain string still
works, so a caller overriding the list is unaffected.

Requires stuttgart-things/helm#155, which adds the state values (defaulting to
true there, so nothing else changes). Against an older helmfile the flags are
simply ignored and the stack stays up.

Verified on u26-kind3: after the run the openebs namespace holds only
openebs-localpv-provisioner, the StorageClass list is down to openebs-hostpath,
and the cluster has no non-Running pod left. The three MinIO StatefulSet PVCs
survive a Helm removal and were deleted separately.
@patrick-hermann-sva
patrick-hermann-sva merged commit 3bb9b27 into main Aug 11, 2026
4 checks passed

This branch was successfully deployed

1 active deployment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant