Contribute to FlashML-org/FreeToken development by creating an account on GitHub.
github.com
GitHub - noonghunna/club-3090: Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.
Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for ...
github.com
GitHub - zolotukhin/zinc: Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon
Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon - zolotukhin/zinc