Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Similar Content

~/bookmarks

A collection of bookmarks filtered by the tag "LLM Inference Optimization".

Filter by:

Showing 1-1 of 1 bookmarks tagged with "LLM Inference Optimization"

All Stories

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% throughput).

GitHub - AtomicBot-ai/atomic-llama-cpp-turboquant: llama.cpp fork with TurboQuant WHT-rotated KV cache...

LLM Inference Optimization Llama.cpp Forks Speculative Decoding Techniques

May 21, 2026

LLM Inference Optimization Bookmarks | William Callahan - Bookmarks