Skip to content

serve: GPU-batched, CUDA and APR/SafeTensors GPU routers are built without AuthGate (APR_API_KEY_HASH ignored) #5478

Open

Description

@noahgift

Found by the #5451 quorum. The CPU GGUF router is gated now; these still build create_router_with_config with no auth layer: crates/apr-cli/src/commands/serve/server.rs (start_gguf_server_gpu_batched), handler_gpu_completion.rs (start_gguf_server_cuda, past its early serve_router fallback), handlers_include_01.rs (start_apr_server_gpu, start_apr_q4k_server_gpu, start_safetensors_server_gpu). Contract: contracts/apr-serve-api-key-auth-v1.yaml (health/metrics not exempt). Fix: route each through AuthGate::from_env() + auth::layer, with a 401/200 test per router (FALSIFY-AUTH-001).

Activity

  1. added this to the 0.73.0 milestone on Oct 17, 2026
  2. added
    ready<=200 lines, scoped, verified not done on origin/main; a worker may pull it
    P1High priority
    and removed
    ready<=200 lines, scoped, verified not done on origin/main; a worker may pull it
    on Oct 18, 2026
  3. modified the milestones: 0.73.0, 0.74.0, 0.75.0 on Oct 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1High priority

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions