Skip to content

feat(dflash2): add selector stop-gradient control - #793

Merged
jiapingW merged 1 commit into
sgl-project:mainfrom
maocheng23:agent/dflash2-selector-stop-gradient
Aug 31, 2026
Merged

feat(dflash2): add selector stop-gradient control#793
jiapingW merged 1 commit into
sgl-project:mainfrom
maocheng23:agent/dflash2-selector-stop-gradient

Conversation

@maocheng23

Copy link
Copy Markdown
Collaborator

Summary

  • add an opt-in training.dflash2_selector_stop_gradient control for DFlash2
  • detach unary logits and draft hidden states only for selector CE, while preserving the primary DFlash/D-PACE/LK gradient path
  • preserve PR support dflash2 #772 behavior by default and persist the resolved semantic in the resume contract
  • document the option and cover config, resume metadata, selector parameters, and the backbone gradient boundary

Tests

  • 54 targeted CPU tests passed
  • 73 related DFlash/runtime tests passed on NVIDIA B200
  • explicit CUDA backward smoke passed: selector gradients finite/nonzero and stopped backbone gradients exactly matched the primary-only reference
  • Black check passed for all changed Python files
  • git diff --check passed

Scope

This PR adds the selector stop-gradient control only. It does not change strict top-k candidate construction or add a gold-replacement selector curriculum.

@jiapingW
jiapingW merged commit ca897ff into sgl-project:main Aug 31, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants