Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

~/bookmarks

A collection of bookmarks filtered by the tag "local llm inference".

Filter by:

Showing 1-20 of 20 bookmarks tagged with "local llm inference"

All Stories

llama-dash.dev

llama-dash — self-hosted inference gateway

Self-Hosted Llama-Dash Local Inference

Oct 19, 2026

news.ycombinator.com

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX...

Qwen Models LLM Quantization Inference Optimization

Oct 5, 2026

github.com

GitHub - Niko1221/Strata: Qwen3.8-Flash-Next (125B MoE) on a 8GB+ NVIDIA...

NVIDIA GPU Mixture-of-Experts Qwen3.8-Flash-Next

Oct 5, 2026

dwarfstar.sh

DwarfStar 4 (ds4): Local DeepSeek V4.1, Qwen and GLM

Mixture-of-Experts 2-Bit Quantization C Inference Engine

Oct 2, 2026

github.com

GitHub - gufo-org/gufo: Strix Halo inference engine. Qwen Flash Next...

On-Device AI AMD Strix Halo Local LLM Inference

Oct 2, 2026

github.com

GitHub - claudejaune/Qwen3.8-Halogen-Flash-Strix-Halo: Run Qwen3.8-Flash-Next (180B, 6B active) on a...

Mixture-of-Experts Halogen Flash Server Qwen 3.8 Flash

Oct 2, 2026

github.com

GitHub - julianmb/halofpx: High-performance Lemonade alternative for AMD Strix Halo...

AMD Strix Halo RDNA 3.5 Local LLM Inference

Oct 1, 2026

openjev.com

SemIf — local decisions in your browser

WebGPU Option Logits Model Quantization

Sep 18, 2026

github.com

GitHub - OnlyTerp/opengrok: Run any model in Grok Bot —...

Grok Bot LLM Model Routing Reasoning Controls

Aug 29, 2026

github.com

GitHub - FlashML-org/FreeToken

Mixture-of-Experts Edge AI LLM Serving

Aug 23, 2026

huggingface.co

EschaLabs/Qwen3.8-27B-Escha-W2 · Hugging Face

Model Quantization Consumer GPU Local LLM Inference

Aug 20, 2026

github.com

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

Speculative Decoding AMD Strix Halo ROCmFP4

Aug 19, 2026

github.com

GitHub - kyuz0/strix-halo-ds4-toolbox

GGUF Models DeepSeek V4 Local LLM Inference

Aug 11, 2026

research.meta.ai

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

Speculative Decoding On-Device LLM Model Quantization

Aug 10, 2026

huggingface.co

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

Quantization-Aware Training Speculative Decoding Gemma 4

Aug 1, 2026

huggingface.co

Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF · Hugging Face

Multimodal AI Models Hugging Face Models Large Language Models

Jun 13, 2026

github.com

GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference...

Apple Silicon Vulkan Metal AMD GPUs

May 3, 2026

localmaxxing.com

localmaxxing — Local LLM Inference

Apple Silicon Hardware Comparison LLM Benchmarks

May 3, 2026

unsloth.ai

NVIDIA Nemotron-3-Super: How To Run Guide | Unsloth Documentation

Llama.cpp Guide Local Inference NVIDIA Nemotron-3-Super

Mar 17, 2026

strixhalo-homelab.d7.wtf

AI-Capabilities-Overview

AI Hardware Platforms Linux Setup Guides GPU Performance Comparisons

Sep 24, 2025

A collection of bookmarks filtered by the tag "local llm inference".

Filter by:

Showing 1-20 of 20 bookmarks tagged with "local llm inference"

All Stories

llama-dash.dev

llama-dash — self-hosted inference gateway

Self-Hosted Llama-Dash Local Inference

Oct 19, 2026

news.ycombinator.com

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX...

Qwen Models LLM Quantization Inference Optimization

Oct 5, 2026

github.com

GitHub - Niko1221/Strata: Qwen3.8-Flash-Next (125B MoE) on a 8GB+ NVIDIA...

NVIDIA GPU Mixture-of-Experts Qwen3.8-Flash-Next

Oct 5, 2026

dwarfstar.sh

DwarfStar 4 (ds4): Local DeepSeek V4.1, Qwen and GLM

Mixture-of-Experts 2-Bit Quantization C Inference Engine

Oct 2, 2026

github.com

GitHub - gufo-org/gufo: Strix Halo inference engine. Qwen Flash Next...

On-Device AI AMD Strix Halo Local LLM Inference

Oct 2, 2026

github.com

GitHub - claudejaune/Qwen3.8-Halogen-Flash-Strix-Halo: Run Qwen3.8-Flash-Next (180B, 6B active) on a...

Mixture-of-Experts Halogen Flash Server Qwen 3.8 Flash

Oct 2, 2026

github.com