Lexicon / CONCEPT
Streaming
A method of delivering AI responses token by token in real-time, so users see the output as it's generated rather than waiting for the complete response.
Streaming sends AI-generated text to your screen as soon as each token is produced, instead of waiting for the entire response to finish. It’s why you see words appearing one by one in chat interfaces.
Why Streaming Matters
- Faster perceived response — users start reading immediately
- Better UX — feels conversational, not like waiting for a loading spinner
- Early cancellation — stop generation if the response is heading in the wrong direction
How It Works
Streaming typically uses Server-Sent Events (SSE) — the server pushes each new token to the client over a persistent HTTP connection. TalkFlux uses SSE to stream responses from all supported providers.