Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Llama.cpp Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "Llama.cpp".

Filter by:

Showing 1-11 of 11 bookmarks tagged with "Llama.cpp"

All Stories

ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF · Hugging Face

ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF · Hugging Face

Mixture-of-Experts Post-Training Quantization Non-Uniform Quantization

Oct 5, 2026

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM inference in C/C++

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

Mixture-of-Experts LLM Inference Speculative Decoding

Aug 30, 2026

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x mainline prefill on MoE.

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

LLM Inference Vulkan Speculative Decoding

Aug 29, 2026

outsourc-e/Qwen3.8-27B-Unleashed-GGUF · Hugging Face

outsourc-e/Qwen3.8-27B-Unleashed-GGUF · Hugging Face

Qwen Dynamic Quantization Uncensored LLM

Aug 23, 2026

Unsloth Dynamic 3.0 GGUFs | Unsloth Documentation

Unsloth Dynamic 3.0 GGUFs | Unsloth Documentation

Unsloth LLM Quantization Post-Training Quantization

Aug 19, 2026

Gemma 4 26B A4B MoE - 500+ t/s decode - Single RTX 4090 (24 GB VRAM) - Llama.cpp concurrency 24 - q8 kv cache

Gemma 4 26B A4B MoE - 500+ t/s decode -...

LLM Inference KV Cache Quantization Continuous Batching

Aug 1, 2026

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

LLM Inference C/C++ Implementation Model Quantization

May 9, 2026

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX...

Local LLM Deployment Llama.cpp GPU Optimization

May 3, 2026

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

LLM Inference C/C++ Implementation Quantization Techniques

Mar 31, 2026

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

SvelteKit Applications Llama.cpp WebUI Guides

Nov 6, 2025

GitHub - kyuz0/amd-strix-halo-toolboxes

GitHub - kyuz0/amd-strix-halo-toolboxes

Developer Toolboxes Large Language Models GPU Acceleration

Sep 24, 2025

Discover More

huggingface.co

October 1, 2026

hipfire-models/qwen3.8-27b · Hugging Face

hipfire-models/qwen3.8-27b · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Hipfire DFlash LLM Quantization AMD GPU Qwen 3.8

LINK

github.com

September 14, 2026

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

qwen38-flash-next recipe for solo GB10. Contribute to bilikaz/qwen38-flash-next-recipe development by creating an account on GitHub.

Qwen LLM Inference Speculative Decoding vLLM NVIDIA DGX Spark

LINK

huggingface.co

August 11, 2026

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Model Quantization ROCmFPX AMD Strix Halo GGUF Muse-Glimmer-30B

LINK