Skip to content

feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) - #9532

Open
mudler wants to merge 11 commits into
masterfrom
feat/buun-llama-cpp-backend
Open

feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache)#9532
mudler wants to merge 11 commits into
masterfrom
feat/buun-llama-cpp-backend

fix(buun-llama-cpp): adapt shared grpc wrapper

b4c662d
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar