Skip to content

Backend portability: correct kernels and config on every CPU, wgpu and CUDA target #5338

Closed as not planned

Description

@noahgift

Scope: Running correctly everywhere: CPU dispatch that picks a narrower kernel than the host supports, wgpu forward hardcoding rope_theta, platform arms for 0.73, orphan source files that never compile, and the pure-Rust cuda-oxide kernel path.

Why it matters: "Runs everywhere" fails when a target silently runs the wrong kernel or a wrong constant, and dark files hide code that no build checks.

Done when: Each target (x86 AVX2/AVX-512, ARM64 NEON, wgpu, CUDA) runs the model ladder smoke with output equal to the reference, and every .rs file under crates/ is compiled by some target.

Epic: #3999. Folded under triage rule 7b (2026-10-14): each row below was its own issue, closed as not planned and kept here as a sub-ticket. Reopen an issue when its work starts or its PR opens.

Sub-tickets

Activity

  1. added this to the 0.73.0 milestone on Oct 14, 2026
  2. added
    bugSomething isn't working
    P2Medium priority
    on Oct 14, 2026
  3. noahgift commented on Oct 22, 2026

    @noahgift
    MemberAuthor

    tracked in #3999

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Medium prioritybugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions