Flare is an open-source research prototype for local inference on NVIDIA SM120/SM121 GPUs, targeting long conversations, coding agents, and repeated tool use.

Models are compiled via PyTorch and CUDA graph capture, then served by a Python-free Rust runtime. It covers fewer models and hardware targets than vLLM, focusing on workstation and compact system workloads.