Skip to content

fabric: tensor parallelism across CUDA processes (bootstrap, NCCL, mailbox and RoCE collectives, plan link, fail-fast) (DeepSeek-V4.1 stack 3/14) - #636

Closed
jayleaton wants to merge 33 commits into
ashhart:mainfrom
jayleaton:stack/03-tp-fabric
Closed

jayleaton wants to merge 33 commits into
ashhart:mainfrom
jayleaton:stack/03-tp-fabric

Commits

  1. Commits on Oct 15, 2026

  2. Commits on Oct 16, 2026

  3. Commits on Oct 17, 2026

  4. Commits on Oct 18, 2026