Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "Local LLM Inference".

Filter by:

Showing 1-10 of 10 bookmarks tagged with "Local LLM Inference"

All Stories

GitHub - OnlyTerp/opengrok: Run any model in Grok Bot — one-command setup, model picker UI, evidence-based provider wire maps, and an update-proof doctor. Not farming you, arming you.

GitHub - OnlyTerp/opengrok: Run any model in Grok Bot —...

Grok Bot LLM Model Routing Reasoning Controls

Aug 29, 2026

GitHub - FlashML-org/FreeToken

GitHub - FlashML-org/FreeToken

Mixture-of-Experts Edge AI LLM Serving

Aug 23, 2026

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

Model Quantization Consumer GPU Local LLM Inference

Aug 20, 2026

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

Speculative Decoding AMD Strix Halo ROCmFP4

Aug 19, 2026

GitHub - kyuz0/strix-halo-ds4-toolbox

GitHub - kyuz0/strix-halo-ds4-toolbox

GGUF Models DeepSeek V4 Local LLM Inference

Aug 11, 2026

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

Quantization-Aware Training Speculative Decoding Gemma 4

Aug 1, 2026

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF · Hugging Face

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF · Hugging Face

Multimodal AI Models Hugging Face Models Large Language Models

Jun 13, 2026

GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference...

Apple Silicon Vulkan Metal AMD GPUs

May 3, 2026

localmaxxing — Local LLM Inference

localmaxxing.com

localmaxxing — Local LLM Inference

Apple Silicon Hardware Comparison LLM Benchmarks

May 3, 2026

AI-Capabilities-Overview

strixhalo-homelab.d7.wtf

AI-Capabilities-Overview

AI Hardware Platforms Linux Setup Guides GPU Performance Comparisons

Sep 24, 2025

Local LLM Inference Bookmarks | William Callahan - Bookmarks