Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

vLLM Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "vLLM".

Filter by:

Showing 1-10 of 10 bookmarks tagged with "vLLM"

All Stories

GitHub - MiaAI-Lab/Qwen3.8-Flash-Next-Single-DGX-Spark: Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)

GitHub - MiaAI-Lab/Qwen3.8-Flash-Next-Single-DGX-Spark: Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)

LLM Inference Qwen3.8-Flash-Next Vision-Language Model

Sep 9, 2026

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

GitHub - MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Sparks: GLM-5.3 Flash EXL3 for 2x DGX Sparks

EXL3 Quantization Speculative Decoding GLM-5.3-Flash

Aug 29, 2026

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX 6000 PRO

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX...

Speculative Decoding Docker Deployment NVFP4 Quantization

Aug 16, 2026

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

RedHatAI/Qwen3.6-35B-A3B-speculator.dspark · Hugging Face

Qwen DSpark Speculative Decoding

Aug 9, 2026

z-lab/Qwen3.6-27B-DFlash · Hugging Face

z-lab/Qwen3.6-27B-DFlash · Hugging Face

LLM Inference Qwen3.6-27B DFlash

Aug 8, 2026

RedHatAI/gemma-4-31B-it-NVFP4 · Hugging Face

RedHatAI/gemma-4-31B-it-NVFP4 · Hugging Face

Gemma 4 Multimodal LLM NVFP4 Quantization

Jul 20, 2026

amd-strix-halo-vllm-toolboxes/rdma_cluster/setup_guide.md at main · kyuz0/amd-strix-halo-vllm-toolboxes

amd-strix-halo-vllm-toolboxes/rdma_cluster/setup_guide.md at main · kyuz0/amd-strix-halo-vllm-toolboxes

Tensor Parallelism RDMA Distributed Inference

Jun 28, 2026

JetBrains/Mellum2-12B-A2.5B-Thinking — 12B / 2.5B active · MOE · 128K ctx

recipes.vllm.ai

JetBrains/Mellum2-12B-A2.5B-Thinking — 12B / 2.5B active · MOE · 128K...

Mixture-of-Experts Reasoning Model Code Assistants

Jun 2, 2026

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX...

Local LLM Deployment Llama.cpp GPU Optimization

May 3, 2026

GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM using vLLM.

GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM...

Machine Learning Infrastructure Large Language Models Model Serving

Aug 17, 2025