Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5723 commits
Select commit Hold shift + click to select a range
60db57e
exl3 cuda: review fixes - plan()'s launches, group reserves after the…
BHCC2025 Oct 28, 2026
9c05804
exl3 cuda: every mid-M, linear_wc and group form the dispatch reaches…
BHCC2025 Oct 28, 2026
a6a1c64
exl3 cuda: the mid-M and linear_wc tables in exl3_midm.zig, so exl3.z…
BHCC2025 Oct 31, 2026
dfc4f21
kernel contract: the EXL3 set joins the family sets, so contract_test…
BHCC2025 Oct 31, 2026
b24a17b
docs: the EXL3 recipe lists TF_EXL3_PDL=0, plain launches for the rot…
BHCC2025 Nov 1, 2026
1e1145c
kernel contract: the Flash Next and EXL3 sets side by side after the …
ashhart Nov 2, 2026
21c8a0f
changelog: #1467 under Unreleased
ashhart Nov 2, 2026
766c505
qwen27 DFlash: compile the drafter head's lane pipeline at load
kieranscotney Oct 31, 2026
cd2e054
Test the rebased DFlash head cache against prompt and decode launches
ashhart Oct 31, 2026
0693d4a
changelog: #1734 under Unreleased
ashhart Nov 2, 2026
554dd6a
lane host: opt-in shortest remaining work first between a long prompt…
gilby Nov 1, 2026
e660881
lane host srpt: honour --decode-share (its share when the prompt goes…
gilby Nov 2, 2026
dae3743
changelog: #1876 under Unreleased
ashhart Nov 2, 2026
cb2b292
starlight: one governed endpoint for TensorFold fleets
ashhart Nov 2, 2026
6612d18
changelog: #1922 under Unreleased
ashhart Nov 2, 2026
3392389
starlight: mdns reads browse answers only after the query returns
ashhart Nov 2, 2026
1bc80d2
starlight: admission makes its fallback waker once
ashhart Nov 2, 2026
89314c6
gemma4: the XPU runner's shard header is read with core's headerSize …
jschmied Nov 1, 2026
2aefc37
build: test-draft-xpu-host and zig build test run gemma4/xpu_dev.zig'…
jschmied Nov 2, 2026
d114693
changelog: #1905 under Unreleased
ashhart Nov 2, 2026
88b0d4b
fix(tools): fail incomplete image benchmark sessions
garvrao80 Nov 2, 2026
805f737
changelog: #1916 under Unreleased
ashhart Nov 2, 2026
5ee5bb7
flashnext: cuda_embed reads its header with core's headerSize and par…
jschmied Nov 1, 2026
45fcab6
changelog: #1917 under Unreleased
ashhart Nov 2, 2026
9d1ffad
flashnext cuda: a shared round's attention in one launch, behind TF_F…
optimisme Nov 2, 2026
c0842b5
changelog: #1739's line carries its number and thanks
ashhart Nov 2, 2026
9bb51cd
zig fmt (Zig 0.17 spellings) on #1739's files
ashhart Nov 2, 2026
72784e2
qwen4 host test: run #1739's merge body (main's zig CI)
ashhart Nov 2, 2026
43e23ac
core: direct_gather reads a loader's mapped views past the page cache…
jschmied Nov 1, 2026
133c789
flashnext cuda: experts load past the page cache, and a load keeps it…
jschmied Nov 1, 2026
0458172
flashnext cuda: release() keeps the n-gram shards' pages, a layer pas…
jschmied Nov 2, 2026
2f339ab
changelog: #1901 under Unreleased
ashhart Nov 2, 2026
4675e47
nemotron: kv_pages grow and keep inline; debug builds assert each pas…
jschmied Nov 2, 2026
b963f32
changelog: #1914 under Unreleased
ashhart Nov 2, 2026
469c14c
core: add a bounded GGUF v3 reader
ashhart Nov 2, 2026
72bf8ed
core: repack finite GGUF blocks into compact affine weights
ashhart Nov 2, 2026
6912945
changelog: core: a GGUF reader and an exact repack of GGUF's quantize…
ashhart Nov 2, 2026
56c8f58
drama3 cuda: reuse a voice reference's prefill across requests
jayleaton Oct 31, 2026
0778b4d
tools: drama_reference_cache_check.py, the GPU check for the Drama re…
jayleaton Oct 31, 2026
72f4deb
drama3 cuda: the reference cache is opt-in, its copied K and V rows t…
jayleaton Nov 2, 2026
0a83dd5
server: the Living Weights view reads a shard's header with core, its…
jschmied Nov 1, 2026
56f9113
changelog: #1923 under Unreleased
ashhart Nov 2, 2026
1a46d6f
fix(qwen35/hip): time shared rounds at the served streams and their r…
AbrahamCete Oct 31, 2026
b76151e
fix(qwen35/hip): time forwards of eight rows or more once
AbrahamCete Nov 1, 2026
cc14ed2
fix(qwen35/hip): time each shared bucket at its own rows up to batch_…
AbrahamCete Nov 2, 2026
3609c1e
changelog: #1830 under Unreleased
ashhart Nov 2, 2026
b31a399
refactor(cache): move the prompt cache Rules into their own file
laudney Nov 2, 2026
a85ad8f
feat(cache): let a family count keyed prompts as repeats
laudney Nov 2, 2026
94cce45
changelog: #1929 under Unreleased
ashhart Nov 2, 2026
ac394f7
feat(hip): add rocBLAS BF16 projections with FP32 sums
laudney Nov 2, 2026
4de3944
changelog: #1930 under Unreleased
ashhart Nov 2, 2026
1cdc24d
docs: Flash Next on a Strix Halo iGPU, three checkpoints with speed a…
gilby Oct 31, 2026
3fb7fe4
docs: the recipe says oQ4e is the quality pick and what the uniform 4…
gilby Nov 2, 2026
7193214
changelog: #1747 under Unreleased
ashhart Nov 2, 2026
02441c3
Enable GitHub Sponsors for TensorFold
ashhart Nov 2, 2026
e014aa7
fix(tokenizer): support checkpoint compatibility normalization
laudney Nov 2, 2026
31dec64
fix(tokenizer): decode normalized added tokens by their spelling
laudney Nov 2, 2026
81edd82
changelog: #1931 under Unreleased
ashhart Nov 2, 2026
f7484b4
feat(server): let a family declare replies without reasoning
laudney Nov 2, 2026
cd75cd3
test(server): check the reasoning hook without pinning the registry
laudney Nov 2, 2026
933b969
changelog: #1933 under Unreleased
ashhart Nov 2, 2026
c3fbea7
compact: read a memory marker from its text parts
ppardus Nov 2, 2026
15fa909
compact: start a memory note after a carriage return
ppardus Nov 2, 2026
3784ff9
compact: drop a carriage return from a remembered file path
ppardus Nov 2, 2026
9cd3763
compact: leave a generated section out after carriage returns
ppardus Nov 2, 2026
9dc6694
cortheon: count the space before a fallback word toward its cap
ppardus Nov 2, 2026
2fa40c3
cortheon: read a shell command that is not the first argument
ppardus Nov 2, 2026
2845868
cortheon: drop a partial character at the end of a text cap
ppardus Nov 2, 2026
648c4ce
changelog: #1939 under Unreleased
ashhart Nov 2, 2026
246d043
feat: add stable profile registry and scoped startup reporting
garvrao80 Nov 2, 2026
16d95cc
changelog: #1944 under Unreleased
ashhart Nov 2, 2026
1173a00
fix(qwen cuda): validate DFlash2 sliding attention declarations
garvrao80 Nov 2, 2026
46aa626
test(qwen cuda): declare sliding attention in cost cache fixtures
garvrao80 Nov 2, 2026
8c3bb8a
changelog: #1946 under Unreleased
ashhart Nov 2, 2026
aec2bad
hip: 4096-row prompt chunks by default on the RDNA 3.5 iGPUs
gilby Oct 30, 2026
c6cd42f
hip: keep 1024-row prompt chunks under --tp unless asked
gilby Nov 2, 2026
bd7b066
changelog: #1651 under Unreleased
ashhart Nov 2, 2026
a3f7889
perf(hip): narrowest stream columns at RDNA3.5's one- and two-row lau…
AbrahamCete Nov 1, 2026
2cc2ef9
refactor(hip): the stream tile's row tile and block width from stream…
AbrahamCete Nov 1, 2026
cb409d9
refactor(hip): assert at comptime that every stream tile width divides 8
AbrahamCete Nov 2, 2026
089a18d
changelog: #1855 under Unreleased
ashhart Nov 2, 2026
f32b725
ci: run the app and mobile checks only when app/, README.md or their …
ashhart Nov 2, 2026
ed39acc
fix(lanes): release a stream that finishes on its first token
laudney Nov 2, 2026
3eb4352
feat(core): add the KV admission ledger
laudney Nov 2, 2026
1721173
feat(core): admit lane jobs against a byte ledger
laudney Nov 2, 2026
c731947
refactor(cuda): decide the stream count in cuda_streams.zig
laudney Nov 2, 2026
f8656d1
feat(cuda): serve per-request families from the KV ledger
laudney Nov 2, 2026
da27d97
docs(core): state the per-request contract on its fields
laudney Nov 2, 2026
5bab525
fix(cuda): size the ledger's prompt cache after every stream
laudney Nov 2, 2026
33429c3
changelog: #1945 under Unreleased
ashhart Nov 2, 2026
f3bce2a
feat(build): check prebuilt images for their one SASS profile
laudney Nov 2, 2026
ae40e5a
feat(build): build one stripped server per GPU with -Dgpu
laudney Nov 2, 2026
0e13f76
docs: document the per-GPU product build
laudney Nov 2, 2026
3dc9693
fix(cuda): refuse a GPU other than the one -Dgpu built for
laudney Nov 2, 2026
4193857
docs(runbook): place the one-GPU build after the archive text
laudney Nov 2, 2026
bba4c38
fix(build): defer -Dgpu refusals to the install step
laudney Nov 2, 2026
405abe1
fix(cuda): name a -Dgpu in a refusal only for an SM it builds
laudney Nov 2, 2026
5ef8242
changelog: #1936 under Unreleased
ashhart Nov 2, 2026
8b8deb8
request_log: the others-can-read test sets its file's mode after crea…
jishnuvenugopal Nov 2, 2026
b7a7230
changelog: #1900 under Unreleased
ashhart Nov 2, 2026
2569e9b
cortheon: own words find each closer in one pass, so unclosed tags no…
jishnuvenugopal Nov 2, 2026
b9e4a8f
cortheon fuzz: own words match the rescan they replace on every input…
jishnuvenugopal Nov 2, 2026
6c74670
changelog: #1898 under Unreleased
ashhart Nov 2, 2026
16bf734
cortheon: read a GitHub file when its host's letters differ
ppardus Nov 2, 2026
ba3750b
cortheon: read a GitHub file from its www host
ppardus Nov 2, 2026
3c26c7a
cortheon: notice a URL written with a capital scheme
ppardus Nov 2, 2026
d0c7848
cortheon: keep a link broken by a carriage return
ppardus Nov 2, 2026
15b688d
cortheon: keep a search result whose scheme is capitalised
ppardus Nov 2, 2026
8e35d52
changelog: #1949 under Unreleased
ashhart Nov 2, 2026
5fe74eb
cortheon: the unclosed-tags linear-time test reads linear_time.Fastes…
ashhart Nov 2, 2026
1db545b
fix(cache): retain exact image identities in prompt states
laudney Nov 2, 2026
2c82d4f
changelog: #1962 under Unreleased
ashhart Nov 2, 2026
0e7c216
fix(hip): an integrated GPU's budget counts its firmware VRAM carve-out
llstrk Nov 2, 2026
c31b032
fix(hip): an integrated GPU counts its own memory only when sysfs say…
llstrk Nov 2, 2026
e16790e
fix(hip): a carve-out's total must match the dedicated VRAM, and the …
llstrk Nov 2, 2026
3437600
changelog: #1963 under Unreleased
ashhart Nov 2, 2026
318d1a5
fix(tools): require observed output for cache benchmark qualification
garvrao80 Nov 2, 2026
8d8e2d7
changelog: #1967 under Unreleased
ashhart Nov 2, 2026
16d4466
docs: Qwen3.8-27B on a 48 GB M5 Pro Mac mini with 1.2.1, drafted and …
pauldodd123 Nov 2, 2026
8914289
changelog: #1947 under Unreleased
ashhart Nov 2, 2026
a218af5
moss_image: the schedule from scheduler_config.json natively, bit for…
BobClawblaw Oct 30, 2026
d8aeab9
changelog: #1670 under Unreleased
ashhart Nov 2, 2026
755db15
qwen3_5 cuda: deferred keeps opt-in (TF_QWEN_KEEP_LATE=1) until their…
ashhart Nov 2, 2026
0e82346
xpu: a server without DPAS leaves the Qwen3.8-27B runner and Gemma 4 …
jschmied Oct 30, 2026
10453b0
xpu: the Gen12LP prompt image takes 8 x 4 tiles (nem_prow_gen12)
jschmied Oct 30, 2026
94ab30f
changelog: #1692 under Unreleased
ashhart Nov 2, 2026
c7ee94f
feat(qwen3_5): map an EXL3 checkpoint's embedding from host memory on…
diwakergupta Oct 30, 2026
e854c28
changelog: #1678 under Unreleased
ashhart Nov 2, 2026
41d6c89
Issue forms and a sharper pull request template
jayleaton Oct 29, 2026
b15a95b
Template and proposal wording from review
jayleaton Nov 1, 2026
21183f7
changelog: #1596 under Unreleased
ashhart Nov 2, 2026
2a92fb6
flashnext cuda: prompt passes with the same bits and less work, and a…
Arminova Oct 31, 2026
e44c670
changelog: #1764 under Unreleased
ashhart Nov 2, 2026
9693706
flashnext cuda: cuda_batch.zig within 600 lines on current main (#176…
ashhart Nov 2, 2026
06eca5d
hip: load a shared expert wider than the routed experts beside the stack
gilby Oct 29, 2026
8530e2b
zig fmt
gilby Oct 30, 2026
b51ab36
hip: register tf_moe_combine_gate with the kernel contract
gilby Oct 30, 2026
2ae3ae4
qwen3_5: refuse a shared expert the HIP index leaves beside the route…
gilby Oct 30, 2026
efd18a9
hip: test tf_moe_combine_gate against tf_moe_combine byte for byte
gilby Oct 30, 2026
dacd40a
changelog: #1612 under Unreleased
ashhart Nov 2, 2026
4f2c5e7
ling: grouped expert routing on Metal, with a float64 reference
ThinkOffApp Oct 30, 2026
70d1739
ling: contract import and Metal limits launcher for tf_ling_route
ThinkOffApp Oct 30, 2026
41db4e2
ling: host tests that pin sigmoid, group score, keep-4 and f64 weights
ThinkOffApp Oct 30, 2026
368941d
ling: reject padded picks and tighten the Metal weight bound to 1e-6
ThinkOffApp Oct 30, 2026
710f936
ling: GPU cases for tied groups and a planted NaN on flash
ThinkOffApp Oct 30, 2026
19d1357
ling: unique picks after NaN, and tests for the last mutation gaps
ThinkOffApp Oct 30, 2026
5635e5d
ling: distinct-ids on the float64 reference, and the NaN weight rule
ThinkOffApp Oct 30, 2026
7539909
ling: empty picks are id 0 with weight 0; Shape.of, Shape.check and t…
ThinkOffApp Nov 2, 2026
c2cd15a
ling: route.zig doc comments one line each, within 120 columns
ThinkOffApp Nov 2, 2026
bfc374f
changelog: #1836 under Unreleased
ashhart Nov 2, 2026
54fb92e
test(hip): pin the planned decode score's bits to its lane order
AbrahamCete Nov 1, 2026
2b4572d
perf(hip): the planned decode score takes four keys a warp on long sp…
AbrahamCete Nov 1, 2026
3d22922
changelog: #1932 under Unreleased
ashhart Nov 2, 2026
4bddc94
glm cuda: TF_GLM_KV_HOST keeps the KV pages' latent rows in pinned ho…
russellmm Oct 31, 2026
160063d
glm cuda: the last rank to map TF_GLM_KV_HOST_SHARED's page file unli…
russellmm Nov 1, 2026
ce42bcd
glm cuda: TF_GLM_KV_HOST_SHARED's /dev/shm pages build on Linux only
russellmm Nov 1, 2026
92e2076
glm cuda: TF_GLM_KV_HOST, _SHARED and _GIB join the ranks' fingerprint
russellmm Nov 1, 2026
fbd733a
glm cuda: TF_GLM_KV_HOST's gather kernels join the contract, and a ca…
russellmm Nov 1, 2026
0b4bd44
glm cuda: a TF_GLM_KV_HOST call past its slots is refused by name, wi…
russellmm Nov 1, 2026
c0e6daf
changelog: #1795 under Unreleased
ashhart Nov 2, 2026
f41bcf4
feat(profile): register GLM paging and report resolved selection
garvrao80 Nov 2, 2026
099ca83
changelog: #1959 under Unreleased
ashhart Nov 2, 2026
f150283
test(hip): pin the decode softmax stats' max and the partial sums' ti…
AbrahamCete Nov 2, 2026
74f1625
perf(hip): the decode softmax stats and partial sums load sixteen ahead
AbrahamCete Nov 2, 2026
532589e
changelog: #1961 under Unreleased
ashhart Nov 2, 2026
e0ee513
hip flashnext: parallel n-gram gather, release weight pages after upload
gilby Oct 29, 2026
8f8947e
zig fmt
gilby Oct 30, 2026
4a2621a
changelog: #1611 under Unreleased
ashhart Nov 2, 2026
104b84a
rebase: release() takes its scratch at the three callers main gained …
ashhart Nov 2, 2026
2b8d2aa
rebase: the CUDA load-cache source tests read release()'s new scratch…
ashhart Nov 2, 2026
021d9af
build: one core module per XPU tree, passed through runtime(), family…
jschmied Nov 2, 2026
d80897e
build: the Nemotron XPU device binaries keep a core at optimize, as o…
jschmied Nov 2, 2026
2e56fe1
changelog: #1918 under Unreleased
ashhart Nov 3, 2026
a566da5
cuda: prioritize verified copies in Nemotron lanes
ashhart Nov 2, 2026
071cefe
changelog: Nemotron CUDA copy drafts under Unreleased
ashhart Nov 2, 2026
b5c96c5
flashnext cuda: the MTP head's experts run on the call's last row only
jschmied Nov 1, 2026
ad98b60
changelog: #1925 under Unreleased
ashhart Nov 2, 2026
dd326f4
glm cuda: a prompt chunk's MTP pass runs its last row past the caches
gilby Nov 2, 2026
e002bf9
changelog: #1577 under Unreleased
ashhart Nov 3, 2026
6d8f689
Account for whole GLM snapshots restored from disk
ashhart Nov 1, 2026
d38bba3
changelog: GLM on Metal: charge disk-restored prompt states at their …
ashhart Nov 1, 2026
9eb5579
test(hip): re-derive every gate-5 record with ROCm 10.1
laudney Nov 3, 2026
cb972b8
changelog: #1979 under Unreleased
ashhart Nov 3, 2026
41a2e8c
feat(cli): add prompt-cache-disk alias and startup reporting
garvrao80 Nov 2, 2026
2730569
fix(cli): reject mixed disk cache spellings and clarify errors
garvrao80 Nov 2, 2026
3bc3c9e
changelog: #1908 under Unreleased
ashhart Nov 3, 2026
95453c5
fix(flashnext): keep the ranked vtable static
laudney Oct 29, 2026
1e7f5db
feat(cuda): serve --tp to the CUDA families with ranks
laudney Oct 29, 2026
d6b3e6e
feat(flashnext): ranks agree on a computed checkpoint digest
laudney Oct 29, 2026
bfc2cc4
feat(flashnext): accept BF16 dense and shared layers in ModelOpt
laudney Oct 29, 2026
89a6600
feat(flashnext): FP8 rows in the n-gram table
laudney Oct 29, 2026
9b6d865
feat(flashnext): FP8 block experts in the MTP head
laudney Oct 31, 2026
7e4c02d
docs(flashnext): serve NVIDIA's NVFP4 checkpoint at TP=2
laudney Oct 29, 2026
a1f124b
refactor(cuda): keep --tp's refusals and test out of cuda.zig
laudney Nov 1, 2026
e516442
test(contract): gate Flash Next NVFP4's BF16 and FP8 expert kernels
laudney Nov 1, 2026
2676a56
fix(flashnext): keep one GPU's expert sums at --tp 2
laudney Nov 1, 2026
afb8293
docs(changelog): note --tp 2 replies equal one GPU's for Flash Next
laudney Nov 1, 2026
6afbcdc
style(contract): shorten comments for the lean rule
laudney Nov 1, 2026
00db33f
fix(flashnext): word the --tp load refusals and credit the PR
laudney Nov 2, 2026
6194b8c
changelog: #1771's line once (the rebase's keep-both copied it three …
ashhart Nov 3, 2026
e463344
cluster: a checkpoint file's header length is checked with core's hea…
ashhart Nov 3, 2026
e7a4c2b
qwen_vl: the Metal tower's shard headers are read with core's headerS…
ashhart Nov 3, 2026
87bf85f
changelog: header readers onto core under Unreleased
ashhart Nov 3, 2026
2ff4e6e
hip: decode router over the bf16 rows the checkpoint holds
gilby Oct 29, 2026
9c35198
contract: the router runner plants a second expert's row only when th…
gilby Nov 2, 2026
099b2d9
changelog: #1614 under Unreleased
ashhart Nov 3, 2026
0b10f70
build: compile-metal-residency-host takes the engine's living module …
ashhart Nov 3, 2026
db04139
qwen3_5 cuda: the weight loaders' host bf16 copies are core's bf16_ro…
ashhart Nov 3, 2026
6703e91
changelog: Qwen 3.5 CUDA bf16 copies under Unreleased
ashhart Nov 3, 2026
4c75dce
core: seven host bf16 copies with a plain + round as bits(), negative…
jschmied Nov 2, 2026
6a50486
changelog: #1954 under Unreleased
ashhart Nov 3, 2026
96b3b7a
glm cuda: TF_GLM_KDA_PAD keeps the fused KDA input stack packed at TP…
BadAd84 Oct 27, 2026
316c0bc
glm cuda: TF_GLM_KDA_PAD - the prompt conv shift strides by the padde…
BadAd84 Oct 27, 2026
842bba3
glm cuda: TF_GLM_KDA_PAD - the shared prompt window strides by the pa…
BadAd84 Oct 27, 2026
6f7f99c
glm cuda: TF_GLM_KDA_PAD - the segment layout's row width is padded too
BadAd84 Oct 27, 2026
831e20c
glm cuda: TF_GLM_KDA_PAD pads to ONE width for every rank
BadAd84 Oct 27, 2026
b7af934
glm cuda: TF_GLM_KDA_PAD - the KDA input linear is packed at the padd…
BadAd84 Oct 27, 2026
6bafb5a
glm cuda: KDA pad - one width for every layer and rank, MTP layer inc…
BadAd84 Oct 27, 2026
9db24e7
glm cuda: the pad's comments are one line each (lean check)
BadAd84 Oct 28, 2026
2d2a84f
glm cuda: TF_GLM_KDA_PAD pads a split KDA stack's bf16 rest too
BadAd84 Oct 29, 2026
367e450
glm cuda: glm-kda-pad-split's header is one line (lean check)
BadAd84 Oct 29, 2026
c309bb3
glm cuda: TF_GLM_KDA_PAD read once into Settings, refused without glm…
BadAd84 Oct 29, 2026
6184cee
changelog: #1545 under Unreleased
ashhart Nov 3, 2026
4deaee2
docs and GLM config: say where decisions are served, refuse a non-bf1…
ashhart Nov 3, 2026
ef9fa70
changelog: GLM activation dtype refusal under Unreleased
ashhart Nov 3, 2026
66924b5
rope: port the three exact frequency copies onto core's helper
ashhart Nov 3, 2026
1e11c0e
changelog: #1995 under Unreleased
ashhart Nov 3, 2026
15af823
glm cuda: the idle KV pool's line reads even under TF_GLM_KV_SHARE
Bizuayeu Nov 2, 2026
9eda955
changelog: #1993 under Unreleased
ashhart Nov 3, 2026
f03d8db
test(cost cache): count a Windows replace-window miss instead of fail…
ashhart Nov 3, 2026
824e562
changelog: #2001 under Unreleased
ashhart Nov 3, 2026
fb7ee09
xpu: the Nemotron loader and the XPU safetensors reader read shard he…
jschmied Nov 2, 2026
060ddc0
changelog: #1919 under Unreleased
ashhart Nov 3, 2026
d8b80bd
dsv41 metal: bf16 and fp32 matvecs and the phase-1 glue
gilby Nov 1, 2026
a23942a
dsv41 metal: the registered glue kernels (norms, RoPE, FP8 and FP4 ro…
gilby Nov 1, 2026
168dd12
build: test-info-config runs info's issue 934 test, which its CUDA CL…
jishnuvenugopal Nov 2, 2026
0f7f5ed
changelog: #2006 under Unreleased
ashhart Nov 3, 2026
ed2cca9
docs: clarify tool-call scope of cache benchmark receipts
garvrao80 Nov 3, 2026
b1f8bad
changelog: #1999 under Unreleased
ashhart Nov 3, 2026
cca9ccb
dsv41 metal: indexer scores, top-512, candidate blocks and the MoE route
gilby Nov 1, 2026
acf12da
dsv41 metal: the KV compressor and Engram
gilby Nov 1, 2026
3ef0357
dsv41 metal: hyper-connection mix, pre and post, and the fused and fo…
gilby Nov 1, 2026
b85ac2e
dsv41 metal: one decoder layer's launch over 1-16 rows, checked stage…
gilby Nov 1, 2026
7258db3
dsv41 metal: the decode forward over every layer, Engram, the head an…
gilby Nov 1, 2026
e1fd2a2
dsv41 metal: prompt chunks and the exact decoder suffix
gilby Nov 1, 2026
d660dbc
dsv41 metal: DSpark drafts
gilby Nov 1, 2026
599fa82
dsv41: the served engine's lane half as a backend-neutral module
gilby Nov 1, 2026
cfcbecb
changelog: #1719 under Unreleased
ashhart Nov 3, 2026
6c30fd8
server: one-call streams send the whole reply's content (#1396)
devopsfortunato Nov 3, 2026
3fda03c
server: GLM tool calls stream their arguments as they are written (#1…
devopsfortunato Nov 3, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
2 changes: 2 additions & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# Text files check out with LF on every platform: tests embed fixtures and compare their bytes.
* text=auto eol=lf
1 change: 1 addition & 0 deletions .github/FUNDING.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
github: ashhart
136 changes: 136 additions & 0 deletions .github/ISSUE_TEMPLATE/bug.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,136 @@
name: Bug report
description: Something TensorFold does wrong, such as a crash, hang, refusal, token mismatch or API error.
labels: ["bug"]
body:
- type: markdown
attributes:
value: |
Thanks for the report. A public request we can run lands a fix fastest.
Write "n/a" and why for a field that does not apply, such as the checkpoint for a build bug.
Do not paste private paths, hostnames, tokens, keys or confidential prompts. Maintainers may relabel the issue.
- type: dropdown
id: component
attributes:
label: Component
options:
- Engine or server
- Desktop app
- Mobile app
- Tools, build or CI
- Documentation or website
- Other
validations:
required: true
- type: dropdown
id: kind
attributes:
label: Kind of failure
options:
- Crash or startup error
- Hang or timeout
- Wrong refusal
- Token mismatch (drafted, resumed or concurrent differs from plain)
- API or streaming error
- Wrong state after cancel, reset or restart
- Build or install failure
- Other
validations:
required: true
- type: textarea
id: behavior
attributes:
label: Expected and actual behavior
description: What you expected, what happened instead, and how often it happens.
validations:
required: true
- type: input
id: version
attributes:
label: TensorFold version or commit
description: The `--version` output or the commit SHA. Say whether it is a release archive, a source build or a fork with changes.
placeholder: "the `--version` output"
validations:
required: true
- type: input
id: last-good
attributes:
label: Last version that worked
description: Optional. A release or commit where this did not happen.
- type: dropdown
id: backend
attributes:
label: Backend
multiple: true
options:
- Metal
- CUDA
- HIP
- XPU
- None (no GPU involved)
- Other
validations:
required: true
- type: dropdown
id: os
attributes:
label: Operating system
multiple: true
options:
- macOS
- Linux
- Windows
- iOS
- Android
validations:
required: true
- type: textarea
id: hardware
attributes:
label: Hardware and runtime
description: Chip or GPU, RAM or VRAM, OS version, and driver, CUDA, ROCm or Xcode versions. Hosts and ranks when it runs on several.
placeholder: Apple M4 Max, 128 GB, macOS 26.1
validations:
required: true
- type: textarea
id: model
attributes:
label: Checkpoint and revision
description: Repository and immutable revision, format or quantization, and the drafter and its revision. "n/a" for a model-free bug.
placeholder: org/model at revision 0123abcd, 4-bit, drafter org/drafter at revision 4567ef01
validations:
required: true
- type: textarea
id: command
attributes:
label: Exact command and request
description: The full launch command, environment options by name, and a public request JSON, token IDs or a script that generates them.
render: shell
validations:
required: true
- type: textarea
id: logs
attributes:
label: Startup output, error and logs
description: The startup lines, error or stack trace, and exit status. Say why if none is available.
render: shell
validations:
required: true
- type: textarea
id: mismatch
attributes:
label: Token mismatch details
description: Optional. The first differing index, both token arrays or `token_sha` hashes, and the drafted and plain settings.
- type: textarea
id: related
attributes:
label: Related issues and pull requests
description: Links to similar reports and how this one differs, or "none found".
validations:
required: true
- type: checkboxes
id: privacy
attributes:
label: Privacy
options:
- label: This report holds no private paths, hostnames, tokens, keys or confidential prompts.
required: true
14 changes: 14 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
blank_issues_enabled: false
contact_links:
- name: Contributing guide
url: https://github.com/ashhart/TensorFold/blob/main/CONTRIBUTING.md
about: Build, exactness, receipts and the issue-first rule for families, backends and arithmetic.
- name: Agent radar
url: https://tensorfold.dev/atc
about: See which issues contributors and agents are working on before choosing one.
- name: Known issues
url: https://github.com/ashhart/TensorFold/blob/main/docs/known-issues.md
about: Problems we already know about, and their workarounds.
- name: Runbook
url: https://github.com/ashhart/TensorFold/blob/main/RUNBOOK.md
about: Installing and running a TensorFold server, with a troubleshooting section.
71 changes: 71 additions & 0 deletions .github/ISSUE_TEMPLATE/feature.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
name: Feature request
description: A new capability or workflow improvement. Use the proposal form for a model family, backend or arithmetic change.
labels: ["enhancement"]
body:
- type: markdown
attributes:
value: |
Describe the problem first; a proposed design is welcome but optional.
Do not paste private paths, hostnames, tokens, keys or confidential prompts. Maintainers may relabel the issue.
- type: dropdown
id: component
attributes:
label: Component
options:
- Engine or server
- Desktop app
- Mobile app
- Tools, build or CI
- Documentation or website
- Other
validations:
required: true
- type: textarea
id: problem
attributes:
label: Problem or use case
description: What you are trying to do and what gets in the way.
validations:
required: true
- type: textarea
id: current
attributes:
label: Current behavior
validations:
required: true
- type: textarea
id: proposal
attributes:
label: Proposed behavior and how to verify it
description: What a user would see, and the checks that would show it works.
validations:
required: true
- type: textarea
id: scope
attributes:
label: Scope and exclusions
description: What this includes and what it leaves out.
validations:
required: true
- type: textarea
id: effects
attributes:
label: Compatibility, API and security effects
description: Optional. Changes to flags, endpoints, defaults or stored data.
- type: textarea
id: alternatives
attributes:
label: Alternatives tried
description: Optional.
- type: textarea
id: environment
attributes:
label: Version, hardware and checkpoint
description: Optional, unless the feature depends on them. The TensorFold version or commit, GPU, and checkpoint and revision.
- type: textarea
id: related
attributes:
label: Related issues and pull requests
description: Links to similar requests and how this one differs, or "none found".
validations:
required: true
138 changes: 138 additions & 0 deletions .github/ISSUE_TEMPLATE/performance.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,138 @@
name: Performance or memory regression
description: TensorFold is slower or uses more memory than it did, or than it should.
body:
- type: markdown
attributes:
value: |
Measure before and after on the same machine, checkpoint, prompts and settings, as CONTRIBUTING.md describes.
A suspected regression is welcome without a patch. Write "n/a" and why for a field that does not apply.
Do not paste private paths, hostnames, tokens, keys or confidential prompts. Maintainers may relabel the issue.
- type: dropdown
id: component
attributes:
label: Component
options:
- Engine or server
- Desktop app
- Mobile app
- Tools, build or CI
- Other
validations:
required: true
- type: dropdown
id: metric
attributes:
label: Metric
multiple: true
options:
- Decode speed
- Prompt processing or time to first token
- Concurrent throughput
- Pauses between tokens
- Memory
- Startup or build time
- Other
validations:
required: true
- type: input
id: versions
attributes:
label: Baseline and candidate versions or commits
description: The faster or smaller one and the slower or larger one. Say whether either is a fork with changes.
placeholder: "the `--version` output for both"
validations:
required: true
- type: dropdown
id: backend
attributes:
label: Backend
multiple: true
options:
- Metal
- CUDA
- HIP
- XPU
- None (no GPU involved)
- Other
validations:
required: true
- type: dropdown
id: os
attributes:
label: Operating system
multiple: true
options:
- macOS
- Linux
- Windows
- iOS
- Android
validations:
required: true
- type: textarea
id: hardware
attributes:
label: Hardware and runtime
description: Chip or GPU, RAM or VRAM, OS version, and driver, CUDA, ROCm or Xcode versions. Hosts and ranks when it runs on several, and any other load.
validations:
required: true
- type: textarea
id: model
attributes:
label: Checkpoint and revision
description: Repository and immutable revision, format or quantization, and the drafter and its revision. "n/a" for a model-free measurement.
validations:
required: true
- type: textarea
id: command
attributes:
label: Exact commands and inputs
description: |
The server and client commands, public prompt IDs, token arrays or a generator, and the settings:
drafts, sampling, thinking, precision, output length, concurrent streams, and cache cold or warm with cached-token counts.
render: shell
validations:
required: true
- type: textarea
id: results
attributes:
label: Results
description: |
Baseline and candidate values with units, the repetitions, the run order and the spread.
For memory, the peak physical process footprint and any device or pinned allocations, with the RAM class and context.
validations:
required: true
- type: textarea
id: equality
attributes:
label: Token equality
description: Whether both runs gave the same tokens, or why tokens do not apply.
validations:
required: true
- type: textarea
id: receipt
attributes:
label: Raw output
description: The tool output or log behind the results, or why it is missing.
render: shell
validations:
required: true
- type: textarea
id: extra
attributes:
label: First bad commit, profile or suspected cause
description: Optional. A bisect result, a profile, or a comparison with another server such as `mlx_lm` or vLLM.
- type: textarea
id: related
attributes:
label: Related issues and pull requests
description: Links to similar reports and how this one differs, or "none found".
validations:
required: true
- type: checkboxes
id: privacy
attributes:
label: Privacy
options:
- label: This report holds no private paths, hostnames, tokens, keys or confidential prompts.
required: true
Loading
Loading