Welcome! Type "help" for available commands.

$

Loading terminal interface...

Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

GPU Optimization Bookmarks | William Callahan - Bookmarks

Similar Content

~/bookmarks

A collection of bookmarks filtered by the tag "GPU Optimization".

Filter by:

Showing 1-2 of 2 bookmarks tagged with "GPU Optimization"

All Stories

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX...

Local LLM Deployment Llama.cpp GPU Optimization

May 3, 2026

Deploying DeepSeek with PD Disaggregation and Large-Scale Expert Parallelism on 96 H100 GPUs | LMSYS Org

Deploying DeepSeek with PD Disaggregation and Large-Scale Expert Parallelism on...

Large Language Models Scalable AI Inference Expert Parallelism

Aug 29, 2025

Discover More

github.com

August 16, 2026

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX 6000 PRO

GitHub - MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000: Qwen3.8 27B for DGX Spark / RTX 6000 PRO

Qwen3.8 27B for DGX Spark / RTX 6000 PRO. Contribute to MiaAI-Lab/Qwen3.8-27B-DGX-Spark-RTX-6000 development by creating an account on GitHub.

Speculative Decoding Docker Deployment NVFP4 Quantization vLLM Qwen 3

LINK

github.com

September 14, 2026

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

GitHub - bilikaz/qwen38-flash-next-recipe: qwen38-flash-next recipe for solo GB10

qwen38-flash-next recipe for solo GB10. Contribute to bilikaz/qwen38-flash-next-recipe development by creating an account on GitHub.

Qwen LLM Inference Speculative Decoding vLLM NVIDIA DGX Spark

LINK

docs.sglang.io

August 17, 2026

Qwen3.8-27B - SGLang Documentation

Qwen3.8-27B - SGLang Documentation

Deploy Qwen3.8-27B with SGLang — dense hybrid GDN vision-language model with BF16/FP8/NVFP4 W4A4 checkpoints and in-checkpoint MTP, single-GPU on H200...

FP8 Quantization Qwen 3 LLM Deployment SGLang Mamba Architecture

LINK