AI Chat with HTTP Streaming
By leveraging HTTP actions with streaming, this chat app balances real-time responsiveness with efficient bandwidth usage. Users receive character-by-...
Page refresh disrupts chatbot UIs like Claude's, which use stateless SSE for token streaming, causing lost responses until generation completes and history loads from a database.
A minimal UI demo using WebSockets and Ably's Pub/Sub resumes streams seamlessly on refresh without persistent storage. Pub/Sub platforms enable reconnection, multi-device support, presence awareness, and efficient token appending, surpassing SSE limitations.