Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Local LLM Inference Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "Local LLM Inference".

Filter by:

Showing 1-13 of 13 bookmarks tagged with "Local LLM Inference"

All Stories

GitHub - julianmb/halofpx: High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

GitHub - julianmb/halofpx: High-performance Lemonade alternative for AMD Strix Halo...

AMD Strix Halo RDNA 3.5 Local LLM Inference

Oct 1, 2026

GitHub - Niko1221/Strata: Qwen3.8-Flash-Next (125B MoE) on a 8GB+ NVIDIA GPU: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

GitHub - Niko1221/Strata: Qwen3.8-Flash-Next (125B MoE) on a 8GB+ NVIDIA...

NVIDIA GPU Mixture-of-Experts Qwen3.8-Flash-Next

Sep 30, 2026

SemIf — local decisions in your browser

SemIf — local decisions in your browser

WebGPU Option Logits Model Quantization

Sep 18, 2026

GitHub - OnlyTerp/opengrok: Run any model in Grok Bot — one-command setup, model picker UI, evidence-based provider wire maps, and an update-proof doctor. Not farming you, arming you.

GitHub - OnlyTerp/opengrok: Run any model in Grok Bot —...

Grok Bot LLM Model Routing Reasoning Controls

Aug 29, 2026

GitHub - FlashML-org/FreeToken

GitHub - FlashML-org/FreeToken

Mixture-of-Experts Edge AI LLM Serving

Aug 23, 2026

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

Model Quantization Consumer GPU Local LLM Inference

Aug 20, 2026

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

Speculative Decoding AMD Strix Halo ROCmFP4

Aug 19, 2026

GitHub - kyuz0/strix-halo-ds4-toolbox

GitHub - kyuz0/strix-halo-ds4-toolbox

GGUF Models DeepSeek V4 Local LLM Inference

Aug 11, 2026

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

Quantization-Aware Training Speculative Decoding Gemma 4

Aug 1, 2026

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF · Hugging Face

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF · Hugging Face

Multimodal AI Models Hugging Face Models Large Language Models

Jun 13, 2026

GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference...

Apple Silicon Vulkan Metal AMD GPUs

May 3, 2026

localmaxxing — Local LLM Inference

localmaxxing.com

localmaxxing — Local LLM Inference

Apple Silicon Hardware Comparison LLM Benchmarks

May 3, 2026

AI-Capabilities-Overview

strixhalo-homelab.d7.wtf

AI-Capabilities-Overview

AI Hardware Platforms Linux Setup Guides GPU Performance Comparisons

Sep 24, 2025

Discover More

huggingface.co

August 11, 2026

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Model Quantization ROCmFPX AMD Strix Halo GGUF Muse-Glimmer-30B

LINK

github.com

October 1, 2026

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

RDNA-native LLM inference engine in Rust. . Contribute to warpfront/hipfire development by creating an account on GitHub.

LLM Inference Speculative Decoding Model Quantization AMD RDNA ROCm

LINK

github.com

September 24, 2025

GitHub - kyuz0/amd-strix-halo-toolboxes

GitHub - kyuz0/amd-strix-halo-toolboxes

Contribute to kyuz0/amd-strix-halo-toolboxes development by creating an account on GitHub.

Developer Toolboxes Large Language Models GPU Acceleration AMD Strix Halo Llama.cpp

LINK