Skip to content

aprender-gpu test_gpu_allocation_under_pressure SIGKILLs on GB10 unified memory (host OOM) — size pressure from MemAvailable or refuse on unified-memory devices #3713

Closed as not planned

Description

@noahgift

Seen as first responder on batch-1 #3707 at eb454d4e1: gpu-quick on gx10-eph, step "aprender-gpu cuda unit tests (--features cuda --lib --release)" (job 106397875044):

test memory::resident::tests::test_gpu_allocation_under_pressure has been running for over 60 seconds
error: test failed, to rerun pass `-p aprender-gpu --lib`
  process didn't exit successfully: `…/trueno_gpu-92a9e66850846a53` (signal: 9, SIGKILL: kill)

The same job passed on the same runner one push earlier (32dd7b666), and the push changed no GPU code. This is the unified-memory host-OOM shape on GB10: an allocation sized for "pressure" on a device whose memory IS host RAM makes the kernel OOM-kill the test process, and under concurrent load it can take the runner's other work with it. gpu-quick is not in gate's needs, so it blocked nothing. A test that can SIGKILL a runner is still a defect.

done_when (cop ruling 2026-09-21)

  • test_gpu_allocation_under_pressure sizes its pressure from the host's MemAvailable (read at test time, with headroom) on a unified-memory device, OR it is refused there by name with an explicit reason. It never allocates past what the host can give.
  • It can never SIGKILL the runner. Proven on a GB10 (gx10) under concurrent load: the test ends in PASS or in a named refusal, never signal 9.
  • A case row or a mutant shows that the sizing reads MemAvailable, not a constant.

Refs #3707

Activity

  1. added this to the 0.70.0 milestone on Sep 21, 2026
  2. modified the milestones: 0.70.0, backlog on Sep 24, 2026
  3. noahgift commented on Sep 25, 2026

    @noahgift
    MemberAuthor

    Parked by APR-EPIC-001: over E1 budget (rank 62/93). Reopen = pull. Applied by aprender-d1: claude+agy both said close, apr shadow row recorded (handoff/close-quorum-2026-09-25.json).

  4. added
    parkedClosed over epic budget (APR-EPIC-001 rule 5). Reopen = pull.
    on Sep 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingparkedClosed over epic budget (APR-EPIC-001 rule 5). Reopen = pull.

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions