Skip to content

🚨 Kernels=True ?! - #47773

Draft
vasqu wants to merge 108 commits into
huggingface:mainfrom
vasqu:default-kernels
Draft

vasqu wants to merge 108 commits into
huggingface:mainfrom
vasqu:default-kernels

Conversation

@vasqu

@vasqu vasqu commented Aug 4, 2026 •

Copy link
Copy Markdown
Collaborator

🤗 Transformers CI

Builds on top of huggingface/kernels#873 and huggingface/kernels#903 -> needs kernels release

Kernels verification progress (compile)

Not important kernel verification progress (compile)

Removed kernels because doesn't make sense: We have proper MoE implementations now with batched/grouped mm and custom triton kernels

  • Llama4 (moe)
  • Gpt oss (moe)

Future kernels that will be added

  • CE loss from liger
  • MLP variations from liger

Comment thread src/transformers/core_model_loading.py Outdated
@github-actions

Copy link
Copy Markdown
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: bamba, bark, beam, diffllama, falcon, falcon_h1, flex_olmo, glm4_moe, gpt_neo, gpt_oss, gptj, higgs_audio_v2, jamba, kyutai_speech_to_text, llama4, mamba2

@github-actions

Copy link
Copy Markdown
Contributor

CI recap

Dashboard: View test results in Grafana
Latest run: 39263564450:1
Result: failure | Jobs: 2 | Tests: 16 | Failures: 0 | Duration: 1m 47s

IlyasMoutawwakil added a commit that referenced this pull request Oct 20, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
shan18 pushed a commit to shan18/transformers that referenced this pull request Oct 20, 2026
* Fix two stale hub-kernel tests

test_kernel_fusion pinned a revision of the dummy kernel repo whose weight
renaming used \2, which rename_source_key no longer expands since huggingface#47755.
Pin the repo's fixed revision, here and in test_faulty_fusion_incomplete_pattern.

test_add_to_mapping_local_then_load downloaded kernels-community/layer-norm as a
model repo, whose stale mirror has no build for current torch. Download it as a
kernel repo, as the kernels library does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* Test add_to_mapping_local with a mocked local kernel, as in huggingface#47773

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants