Experience Education

Projects Bookmarks Investments Contact Blog

Welcome! Type "help" for available commands.

$

Loading terminal interface...

LLM Inference Bookmarks | William Callahan - Bookmarks

Similar Content

~/bookmarks

A collection of bookmarks filtered by the tag "LLM Inference".

Filter by:

Showing 1-5 of 5 bookmarks tagged with "LLM Inference"

All Stories

Fireworks AI - Fastest Inference for Generative AI

Fireworks AI - Fastest Inference for Generative AI

LLM Inference Generative AI AI Infrastructure

Jun 9, 2026

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

GitHub - QuinsZouls/llama-cpp-turboquant at llama-next

LLM Inference C/C++ Implementation GGUF Models

May 9, 2026

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built for specific consumer hardware.

GitHub - Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built...

LLM Inference Speculative Decoding CUDA Optimization

May 3, 2026

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

GitHub - ubergarm/llama.cpp at ug/port-sweep-bench

LLM Inference GGUF Models Llama.cpp

Mar 31, 2026

Running 122B-Parameter LLMs Locally on AMD Strix Halo for OpenClaw: A Deep Dive | LinkedIn

Running 122B-Parameter LLMs Locally on AMD Strix Halo for OpenClaw:...

Local LLMs AMD Strix Halo LLM Inference

Mar 21, 2026