Skip to content

LFM3-1.7B on the XPU backend (Intel GPUs, Iris Xe first) #1666

Open

Description

@jschmied

Goal

Serve LFM3-1.7B (text, MLX affine 4-bit, group 64) on the XPU backend, so the Intel GPU path has a model that fits small machines. The first target is an Iris Xe laptop (Gen12LP, no DPAS, 16 GB shared RAM). Nemotron 3.5 Lightning 30B-A3B, the only model XPU serves today, does not fit there.

Scope

Order

  1. The kernels plus contract checks with synthetic weights, so no checkpoint is needed.
  2. The forward on the checkpoint, with the FP64 reference compared layer by layer.
  3. Wiring into xpu-native serve and the docs/recipes/xpu-arc.md table, then measuring on Iris Xe and, if someone has one, on Arc.

Related: #1491 (LFM3 on Metal), #1508 (LFM3 on CUDA), #1513 (LFM3 admission).

Activity

  1. jschmied commented on Oct 30, 2026

    @jschmied
    ContributorAuthor

    /atc claim

  2. ashhart commented on Oct 31, 2026

    @ashhart
    Owner

    Thanks @jschmied. A model that fits an Iris Xe laptop is a good next step for XPU.

    The plan and order are right. Kernels with synthetic-weight contract checks first, then the forward against FP64 layer
    by layer, then serve and the recipe table. Reusing qmv4, attn and glue where they fit, and one plain sub-group
    kernel for the short convolution, is fine.

    It stacks on #1513, still a draft, so that decides when it can land. Greedy tokens against CUDA and Metal are a useful
    check. Please report them as agreement, since the backends' sums differ.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions