Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Llama.cpp Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "Llama.cpp".

Filter by:

Showing 1-10 of 10 bookmarks tagged with "Llama.cpp"

All Stories

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM inference in C/C++

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

Mixture-of-Experts LLM Inference Speculative Decoding

Aug 30, 2026

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x mainline prefill on MoE.

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

LLM Inference Vulkan Speculative Decoding

Aug 29, 2026

outsourc-e/Qwen3.8-27B-Unleashed-GGUF · Hugging Face

outsourc-e/Qwen3.8-27B-Unleashed-GGUF · Hugging Face

Qwen Dynamic Quantization Uncensored LLM

Aug 23, 2026

Unsloth Dynamic 3.0 GGUFs | Unsloth Documentation

Unsloth Dynamic 3.0 GGUFs | Unsloth Documentation

Unsloth LLM Quantization Post-Training Quantization

Aug 19, 2026

Gemma 4 26B A4B MoE - 500+ t/s decode - Single RTX 4090 (24 GB VRAM) - Llama.cpp concurrency 24 - q8 kv cache

Gemma 4 26B A4B MoE - 500+ t/s decode -...

LLM Inference KV Cache Quantization Continuous Batching

Aug 1, 2026

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

LLM Inference C/C++ Implementation Model Quantization

May 9, 2026

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX...

Local LLM Deployment Llama.cpp GPU Optimization

May 3, 2026

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

LLM Inference C/C++ Implementation Quantization Techniques

Mar 31, 2026

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

SvelteKit Applications Llama.cpp WebUI Guides

Nov 6, 2025

GitHub - kyuz0/amd-strix-halo-toolboxes

GitHub - kyuz0/amd-strix-halo-toolboxes

Developer Toolboxes Large Language Models GPU Acceleration

Sep 24, 2025