WebUI Svelte App for llama.cpp · ggml-org/llama.cpp
Overview This guide highlights the key features of the new SvelteKit-based WebUI of llama.cpp. The new WebUI in combination with the advanced backend ...
Summary
A command-line interface tool for serving LLM using vLLM. - Chen-zexi/vllm-cli