Posts tagged LLM

Learn how to stream LLM tokens to the browser with server sent events, cache repeated prompts and measure time to first token in a small Python service.

A practical tutorial on how an AI voice call works, from microphone to speech to model to voice, with latency tips and a Python loop you can adapt.