Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Welcome! Type "help" for available commands.

$

Loading terminal interface...

Similar Content

Bookmarks tagged with "Structured Generation"

A collection of bookmarks filtered by the tag "Structured Generation".

Filter by:

Showing 1-2 of 2 bookmarks tagged with "Structured Generation"

All Stories

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

harshatheg/Qwen-2.5-1B-RLCD · Hugging Face

LLM Inference Apple Silicon Parallel Constrained Decoding

Sep 16, 2026

Tool calling, open source, and the M×N problem

thetypicalset.com

Tool calling, open source, and the M×N problem

Wire Formats Grammar Engines Tool Calling

Apr 14, 2026

Discover More

ubicloud.com

October 26, 2026

Fixing Tool-Call Accuracy in vLLM

Fixing Tool-Call Accuracy in vLLM

Tool call accuracy is an important part of serving open-weight AI models. When your tool calls aren’t accurate, the model builds up on nonsensical con...

Constrained Decoding Open Weight Models Schema Accuracy vLLM Tool Calling

LINK

github.com

April 6, 2026

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

GitHub - centminmod/or-cli: Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally support Microsoft LLMLingua prompt token compression

Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. Optionally supp...

AI Model APIs Ollama Local Models OpenRouter Integration Python CLI Tools Prompt Token Compression

LINK

perplexity.ai

September 3, 2026

Optimizing On-Device Inference for Apple Silicon

Optimizing On-Device Inference for Apple Silicon

A custom local engine that improves prefill and decode throughput

Mixture-of-Experts LLM Inference Apple Silicon Metal Kernels On-Device Inference

LINK