Llama4

[ehartford]

Requesting llama 4 🦙

[HanGuo97]

Hey, thanks for your interest!

FLUTE (the kernel side) itself has no problem, to my knowledge, supporting llama 4. We don’t have pre-quantized llama-4 models, but I believe the HF integration should make this relatively easy to achieve.