Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

~/bookmarks

A collection of bookmarks filtered by the tag "Speculative Decoding".

Filter by:

Showing 1-16 of 16 bookmarks tagged with "Speculative Decoding"

All Stories

github.com

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

LLM Inference Speculative Decoding Model Quantization

Oct 1, 2026

localmaxxing.com

Qwen3.8-27B-TT-Mixed-BFP4-BFP8-P150 — 56.4 tok/s on Tenstorrent P150 · 32 GB

Tenstorrent P150 Speculative Decoding BFP4 Quantization

Sep 28, 2026

github.com

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

Qwen LLM Inference Speculative Decoding

Sep 14, 2026

github.com

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

Speculative Decoding NVFP4 Qwen3.8-27B

Sep 12, 2026

github.com

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

Mixture-of-Experts LLM Inference Speculative Decoding

Aug 30, 2026

github.com

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

LLM Inference Vulkan Speculative Decoding

Aug 29, 2026

github.com

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

Speculative Decoding Qwen3.8-27B DFlash2

Aug 29, 2026

github.com

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

EXL3 Quantization Speculative Decoding GLM-5.3-Flash

Aug 29, 2026

github.com

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

Speculative Decoding AMD Strix Halo ROCmFP4

Aug 19, 2026

github.com

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX...

Speculative Decoding Docker Deployment NVFP4 Quantization

Aug 16, 2026

research.meta.ai

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

Speculative Decoding On-Device LLM Model Quantization

Aug 10, 2026

huggingface.co

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

Qwen DSpark Speculative Decoding

Aug 9, 2026

huggingface.co

z-lab/Qwen3.6-27B-DFlash · Hugging Face

LLM Inference Qwen3.6-27B DFlash

Aug 8, 2026

huggingface.co

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

Quantization-Aware Training Speculative Decoding Gemma 4

Aug 1, 2026

github.com

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built...

LLM Inference RTX 3090 Quantization Kernels

May 3, 2026

huggingface.co

RedHatAI/gemma-4-31B-it-speculator.eagle3 · Hugging Face

vLLM Integration Gemma Model Eagle-3 Algorithm

Apr 11, 2026

A collection of bookmarks filtered by the tag "Speculative Decoding".

Filter by:

Showing 1-16 of 16 bookmarks tagged with "Speculative Decoding"

All Stories

github.com

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

LLM Inference Speculative Decoding Model Quantization

Oct 1, 2026

localmaxxing.com

Qwen3.8-27B-TT-Mixed-BFP4-BFP8-P150 — 56.4 tok/s on Tenstorrent P150 · 32 GB

Tenstorrent P150 Speculative Decoding BFP4 Quantization

Sep 28, 2026

github.com

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

Qwen LLM Inference Speculative Decoding

Sep 14, 2026

github.com

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

Speculative Decoding NVFP4 Qwen3.8-27B

Sep 12, 2026

github.com

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

Mixture-of-Experts LLM Inference Speculative Decoding

Aug 30, 2026

github.com

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

LLM Inference Vulkan Speculative Decoding

Aug 29, 2026

github.com

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

Speculative Decoding Qwen3.8-27B DFlash2

Aug 29, 2026

github.com

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

EXL3 Quantization Speculative Decoding GLM-5.3-Flash

Aug 29, 2026

github.com

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

Speculative Decoding AMD Strix Halo ROCmFP4

Aug 19, 2026

github.com

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX...

Speculative Decoding Docker Deployment NVFP4 Quantization

Aug 16, 2026

research.meta.ai

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

Speculative Decoding On-Device LLM Model Quantization

Aug 10, 2026

huggingface.co

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

Qwen DSpark Speculative Decoding

Aug 9, 2026

huggingface.co

z-lab/Qwen3.6-27B-DFlash · Hugging Face

LLM Inference Qwen3.6-27B DFlash

Aug 8, 2026

huggingface.co

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

Quantization-Aware Training Speculative Decoding Gemma 4

Aug 1, 2026

github.com

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built...

LLM Inference RTX 3090 Quantization Kernels

May 3, 2026

huggingface.co

RedHatAI/gemma-4-31B-it-speculator.eagle3 · Hugging Face

vLLM Integration Gemma Model Eagle-3 Algorithm

Apr 11, 2026

~/bookmarks

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

Qwen3.8-27B-TT-Mixed-BFP4-BFP8-P150 — 56.4 tok/s on Tenstorrent P150 · 32 GB

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX...

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

z-lab/Qwen3.6-27B-DFlash · Hugging Face

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built...

RedHatAI/gemma-4-31B-it-speculator.eagle3 · Hugging Face

Discover More

hipfire-models/qwen3.8-27b · Hugging Face

GitHub - julianmb/halofpx: High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face

Similar Content

GitHub - warpfront/hipfire: RDNA-native LLM inference engine in Rust.

Qwen3.8-27B-TT-Mixed-BFP4-BFP8-P150 — 56.4 tok/s on Tenstorrent P150 · 32 GB

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

GitHub - quimmedes/cafe-llama.cpp: A experimental fork of llama.cpp with LLM...

GitHub - LaurentZuijdwijk/llama.cpp: llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and...

GitHub - sxuff/qwen38-27b-nvfp4-dflash2-dgx-spark: Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe...

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

GitHub - julianmb/q38rocm: Qwen 3.8 27B ROCmFP4 on AMD Strix...

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX...

Introducing Muse Glimmer: An Open Agentic Model That Runs on...

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

z-lab/Qwen3.6-27B-DFlash · Hugging Face

unsloth/gemma-4-26B-A4B-it-qat-GGUF · Hugging Face

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built...

RedHatAI/gemma-4-31B-it-speculator.eagle3 · Hugging Face

Discover More

hipfire-models/qwen3.8-27b · Hugging Face

GitHub - julianmb/halofpx: High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

vmlinux/Muse-Glimmer-30B-ROCmFPX-GGUF · Hugging Face