Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

On-Device AI Deployment Bookmarks | William Callahan - Bookmarks

Similar Content

~/bookmarks

A collection of bookmarks filtered by the tag "On-Device AI Deployment".

Filter by:

Showing 1-1 of 1 bookmarks tagged with "On-Device AI Deployment"

All Stories

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% throughput).

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache...

LLM Inference Optimization Llama.cpp Forks Speculative Decoding Techniques

May 21, 2026