Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Model Quantization Bookmarks | William Callahan - Bookmarks

Similar Content

~/bookmarks

A collection of bookmarks filtered by the tag "Model Quantization".

Filter by:

Showing 1-9 of 9 bookmarks tagged with "Model Quantization"

All Stories

SemIf — local decisions in your browser

SemIf — local decisions in your browser

WebGPU Option Logits Model Quantization

Sep 18, 2026

AMD Strix Halo — Backend Benchmarks (Grid View)

kyuz0.github.io

AMD Strix Halo — Backend Benchmarks (Grid View)

LLM Inference Vulkan Model Quantization

Aug 26, 2026

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

Model Quantization Consumer GPU Local LLM Inference

Aug 20, 2026

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

Model Quantization ROCmFPX AMD Strix Halo

Aug 11, 2026

Introducing Muse Glimmer: An Open Agentic Model That Runs on Your Device

research.meta.ai

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

Speculative Decoding On-Device LLM Model Quantization

Aug 10, 2026

PrismML — Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone

PrismML — Announcing Bonsai 27B: The First 27B-Class Model to...

On-Device AI Multimodal LLM Model Quantization

Jul 14, 2026

Holo3.1 - H Company

Holo3.1 - H Company

AI Computer Use Agents Mobile Automation Model Quantization

Jun 3, 2026

PrismML — Introducing 1-bit and Ternary Bonsai Image 4B: Image Generation for Local Devices

PrismML — Introducing 1-bit and Ternary Bonsai Image 4B: Image...

Apple Silicon Optimization Image Generation Models Model Quantization

May 31, 2026

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

LLM Inference C/C++ Implementation Model Quantization

May 9, 2026

Discover More

github.com

November 6, 2025

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

WebUI Svelte App for llama.cpp · ggml-org/llama.cpp

Overview This guide highlights the key features of the new SvelteKit-based WebUI of llama.cpp. The new WebUI in combination with the advanced backend ...

SvelteKit Applications Llama.cpp WebUI Guides Command Line Tools AI Model Deployment

LINK

github.com

April 6, 2026

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally supp...

AI Model APIs Ollama Local Models OpenRouter Integration Python CLI Tools Prompt Token Compression

LINK

github.com

August 19, 2026

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64. - julianmb/q38rocm

Speculative Decoding AMD Strix Halo ROCmFP4 Qwen 3.8 Local LLM Inference

LINK