Parallel Constrained Decoding Bookmarks | William Callahan

ubicloud.com

October 26, 2026

Fixing Tool-Call Accuracy in vLLM

Tool call accuracy is an important part of serving open-weight AI models. When your tool calls aren’t accurate, the model builds up on nonsensical con...

github.com

April 6, 2026

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally supp...

perplexity.ai

September 3, 2026

Optimizing On-Device Inference for Apple Silicon

A custom local engine that improves prefill and decode throughput

Bookmarks tagged with "Parallel Constrained Decoding"

Bookmarks tagged with "Parallel Constrained Decoding"

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

Discover More

Fixing Tool-Call Accuracy in vLLM

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

Optimizing On-Device Inference for Apple Silicon

Similar Content

Bookmarks tagged with "Parallel Constrained Decoding"

Bookmarks tagged with "Parallel Constrained Decoding"

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

Discover More

Fixing Tool-Call Accuracy in vLLM

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

Optimizing On-Device Inference for Apple Silicon