Skip to content

fix(tokenizer): the unknown token is the model's, not BPE's — Qwen3.5 serves; a model with no vocabulary refuses by name (PMAT-3609) - #3678

Closed
noahgift wants to merge 1 commit into
mainfrom
PMAT-3609-bpe-unk-optional
Closed

fix(tokenizer): the unknown token is the model's, not BPE's — Qwen3.5 serves; a model with no vocabulary refuses by name (PMAT-3609)#3678
noahgift wants to merge 1 commit into
mainfrom
PMAT-3609-bpe-unk-optional

Commits

  1. Commits on Sep 21, 2026