How is is possible that we’ve made incredible gains in the performance of models, but virtually no gains in the infrastructure that supports them?.
.....
s2.dev
S2, the durable stream API
The serverless API for unlimited, durable, real-time streams
stack.convex.dev
AI Chat with HTTP Streaming
By leveraging HTTP actions with streaming, this chat app balances real-time responsiveness with efficient bandwidth usage. Users receive character-by-...