feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) - #9532

Open

mudler wants to merge 11 commits into

feat/buun-llama-cpp-backend

Commits on Sep 12, 2026

feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache)

mudler
authored and
localai-org-maint-bot
committed
8774ea2
test(gallery): extend importer specs to cover buun-llama-cpp

mudler
authored and
localai-org-maint-bot
committed
21b09e2
fix(buun-llama-cpp): backport logit_bias_eog field to grpc-server copy

mudler
authored and
localai-org-maint-bot
committed
6829ac8
fix(buun-llama-cpp): drop logit_bias_eog arg from params_from_json_cmpl

mudler
authored and
localai-org-maint-bot
committed
8621b95
ci(buun-llama-cpp): wire backend into test-extra + build matrix

mudler
authored and
localai-org-maint-bot
committed
cee043f
fix(buun-llama-cpp): shim atomicAdd(double*,double) for pre-sm_60 CUDA

mudler
authored and
localai-org-maint-bot
committed
dc0e626
fix(buun-llama-cpp): pass WARP_SIZE to argmax __shfl_xor_sync calls

mudler
authored and
localai-org-maint-bot
committed
b2753c1
fix(buun-llama-cpp): shim cudaMemcpy{To,From}Symbol + WARP_SIZE on fwht128 shuffles

mudler
authored and
localai-org-maint-bot
committed
0c260fb
fix(buun-llama-cpp): match speculative draft split anchor
localai-org-maint-bot
committed
e5994af
fix(buun-llama-cpp): isolate fork patch series
localai-org-maint-bot
committed
6075d59
fix(buun-llama-cpp): adapt shared grpc wrapper
localai-org-maint-bot
committed
b4c662d