Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

vLLM Bookmarks | William Callahan - Bookmarks

~/bookmarks

Similar Content

A collection of bookmarks filtered by the tag "vLLM".

Filter by:

Showing 1-3 of 3 bookmarks tagged with "vLLM"

All Stories

JetBrains/Mellum2-12B-A2.5B-Thinking — 12B / 2.5B active · MOE · 128K ctx

recipes.vllm.ai

JetBrains/Mellum2-12B-A2.5B-Thinking — 12B / 2.5B active · MOE · 128K...

Mixture-of-Experts Large Language Models vLLM

Jun 2, 2026

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX...

Local LLM Deployment Llama.cpp vLLM

May 3, 2026

GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM using vLLM.

GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM...

Machine Learning Infrastructure Large Language Models Command Line Tools

Aug 17, 2025

Discover More

huggingface.co

July 21, 2025

Qwen/Qwen3-235B-A22B-Instruct-2507 · Hugging Face

Qwen/Qwen3-235B-A22B-Instruct-2507 · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Large Language Models Machine Learning Deployment Hugging Face Artificial Intelligence Model Performance Benchmarks

LINK

huggingface.co

July 15, 2025

unsloth/Kimi-K2-Instruct-GGUF · Hugging Face

unsloth/Kimi-K2-Instruct-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Mixture-of-Experts Open Source Projects Hugging Face Artificial Intelligence Models Language Model Benchmarks

LINK

openrouter.ai

December 2, 2025

Trinity Mini (free) - API, Providers, Stats

Trinity Mini (free) - API, Providers, Stats

Trinity Mini is a 26B-parameter (3B active) sparse mixture-of-experts language model featuring 128 experts with 8 active per token. Engineered for eff...

AI Coding Tools API Documentation Language Models Open Source LLM Sparse Mixture-of-Experts

LINK