GitHub - ubergarm/llama.cpp at ug/port-sweep-bench
LLM inference in C/C++. Contribute to ubergarm/llama.cpp development by creating an account on GitHub.
Welcome! Type "help" for available commands.
$
Open Source Web UI
Summary
A guide to the new SvelteKit WebUI for llama.cpp that works with the llama-server backend, offering a fast local interface with parallel chats, multimodal inputs and structured JSON output while managing resources efficiently.
Highlights
- SvelteKit front‑end delivers a responsive web UI for llama.cpp.
- Supports parallel conversations and multimodal inputs such as images and PDFs.
- Provides structured JSON responses for easy integration.
- Implements advanced caching to reduce memory and CPU load.
auto-generated
Context
Audience
Developers and AI practitioners who want to run large language models locally with a modern web interface
DomainMachine Learning
Formatopen source web application
Accessfree online
Topics
Related
llama.cpp repositoryllama-server documentationSvelteKit frameworkAI model quantization
