You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
fix(qa): ollama_parity cannot measure on unified memory, ollama stays resident while apr plans its GPU load #5302
apr qa --ollama-from-file on the 8 GB unified-memory Orin (runner label jetson) fails the ollama_parity gate without measuring: ollama's import is resident while apr plans its GPU load, so apr refuses on capacity:
ollama_parity could not run: ... GPU capacity refused: ... weights 1211 MiB + KV 3 MiB + workspace 137 MiB + overhead 512 MiB = 1863 MiB, against 1134 MiB free of 5706 MiB (unified memory: MemAvailable 3036 MiB less a 1902 MiB headroom ...)
On a unified-memory device the two engines share one pool, so the gate must measure them one after the other (unload ollama, keep_alive: 0, before apr loads), or the parity row never exists on edge devices. Model Qwen3.5-2B-Q4_K_M.gguf, apr 0.71.2 at #5292 head cebe27dc.
Done when the edge nightly's ollama parity row is measured on this device.
merged into #5305 (master ticket for epic #3598; triage rule 7b, 2026-10-14). It is a checklist row there; reopen this issue when work on it starts or its PR opens.
Moved: this sub-ticket is now a row in #5321 (apr memory footprint: serve Qwen3.5 within 8 GB unified-memory ARM64 CUDA (Orin)), split out of #5305 by theme.
Activity
noahgift commentedon Oct 14, 2026
merged into #5305 (master ticket for epic #3598; triage rule 7b, 2026-10-14). It is a checklist row there; reopen this issue when work on it starts or its PR opens.
noahgift commentedon Oct 14, 2026
Moved: this sub-ticket is now a row in #5321 (apr memory footprint: serve Qwen3.5 within 8 GB unified-memory ARM64 CUDA (Orin)), split out of #5305 by theme.