Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

On-Device AI Deployment Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "On-Device AI Deployment".

Filter by:

Showing 1-1 of 1 bookmarks tagged with "On-Device AI Deployment"

All Stories

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% throughput).

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache...

On-Device AI Deployment LLM Quantization & Compression Llama.cpp Forks

May 21, 2026

Discover More

github.com

May 9, 2026

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

LLM inference in C/C++. Contribute to QuinsZouls/llama-cpp-turboquant development by creating an account on GitHub.

LLM Inference C/C++ Implementation Model Quantization GGUF Models Llama.cpp

LINK

github.com

March 31, 2026

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

LLM inference in C/C++. Contribute to ubergarm/llama.cpp development by creating an account on GitHub.

LLM Inference C/C++ Implementation Quantization Techniques GGUF Models Llama.cpp

LINK

github.com

August 29, 2026

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x mainline prefill on MoE.

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x mainline prefill on MoE.

llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x ma...

LLM Inference Vulkan Speculative Decoding AMD Strix Halo Llama.cpp

LINK